Skip to content

About

Deriving and implementing the core mathematical foundations of machine learning from scratch. Theory, proofs, and hardware benchmarks across vector spaces, matrix factorizations, calculus, and optimization.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Mathematics of Machine Learning: From Scratch

A hands-on, chapter-by-chapter study accompanying Tivadar Danka's Mathematics of Machine Learning (Packt Publishing).

This repository bridges abstract mathematical theory with practical software engineering:

  • Theory & Proofs: Synthesized conceptual notes, geometric interpretations, and theorem breakdowns.
  • Algorithms from Scratch: Pure Python and vectorized NumPy implementations of key operations (Gram-Schmidt, LU decomposition, QR algorithm, numerical differentiation, gradient descent).
  • Benchmarking & Systems Profile: Exploring memory layouts (C contiguous arrays vs. Python pointer collections), BLAS/LAPACK optimizations, and runtime trade-offs.

Curriculum & Roadmap

  1. Part I: Linear Algebra (Vectors, Norms, Transforms, LU, SVD, Graph Duality)
  2. Part II: Univariate Calculus (Sequences, Differentiation, Optimization, Integration)
  3. Part III: Multivariable Calculus (Jacobians, Hessians, Multivariable Gradient Descent)
  4. Part IV: Probability Theory (Measure Spaces, Random Variables, Information Theory, MLE)

About

Deriving and implementing the core mathematical foundations of machine learning from scratch. Theory, proofs, and hardware benchmarks across vector spaces, matrix factorizations, calculus, and optimization.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors