Calculus is essential across mathematics. This section is designed to take you from fundamental calculus concepts to the advanced techniques essential for optimization and analysis. Building on the foundation laid in Linear Algebra, we explore how calculus is applied to analyze and optimize complex systems. We begin with the classical notion of derivatives — from scalar functions to those of vectors and matrices — and gradually introduce numerical optimization (gradient descent, Newton's method, constrained optimization, duality) and the integration theory needed to make probability rigorous (Riemann, measure, Lebesgue). The section then builds the analytical foundations of modern analysis itself: metric and topological spaces, the functional analysis block (Banach and Hilbert spaces, bounded linear operators, dual spaces, weak topologies, spectral theory, RKHS), and the theory of Lp spaces. The unifying theme is completeness — the absence of mathematical holes — which is what makes computation on continuous objects principled rather than merely approximate.
In the broader framework of the Compass, this section is The Continuous World: the realm of smooth change, infinite processes, and limits. Where The Discrete World (Section IV) studies finite and countable structures, here we study what happens when objects can be approximated arbitrarily closely but never reached in finitely many steps. Section II inherits the algebraic vocabulary of Section I — vector spaces, inner products, and linear operators are the basic objects of functional analysis — and supplies the measure-theoretic foundations that Probability & Statistics (Section III) needs to define expectation, densities, and conditional probability rigorously. The optimization machinery developed here, together with the spaces in which that optimization takes place, also underpins the loss-landscape analysis and the high-dimensional inference engines that appear throughout Section V.
Section II's most active recent expansion has been the functional analysis block (calc-23 through calc-28: Banach and Hilbert spaces, bounded operators, dual spaces and Riesz representation, weak topologies and Banach-Alaoglu, spectral theory of compact operators, and reproducing-kernel Hilbert spaces) together with the Lp space theory (construction, completeness via Riesz-Fischer, and the convergence-mode landscape). The next steps in this arc are a forthcoming Fourier analysis in Hilbert spaces page — instantiating Plancherel's theorem and Heisenberg's uncertainty principle as concrete consequences of the abstract spectral framework — and a smooth manifold series (atlases, tangent spaces and the pushforward, vector fields and flows, eventually Riemannian metrics and curvature). The manifold series in particular provides the geometric infrastructure for the Geometric Deep Learning viewpoint in Section V, where curved parameter spaces and continuous symmetry constrain neural-network architecture.