Calculus and Optimization
“Master single/multivariable calculus, Taylor series, convexity, KKT conditions, duality, Gradient Descent, and Newton's method for GATE DA.”
A comprehensive academic study notebook covering single and multivariable limits, L'Hôpital's rule, Mean Value Theorems, Taylor and Maclaurin expansions, directional derivatives, gradient vectors, Hessian curvature matrices, critical point classification, convex sets and functions, Jensen's inequality, Lagrangian duality, Slater's condition, method of Lagrange multipliers, Karush-Kuhn-Tucker (KKT) conditions, Gradient Descent convergence dynamics, Lipschitz smoothness, and Newton-Raphson second-order optimization. Modeled on the reference Operating Systems benchmark for the official GATE Data Science & AI (DA) curriculum.
Structured Notes & Exam Lens
A · B.Tech Structured Study Sequence
5 Sections · Full CurriculumSingle-Variable Calculus, Limits & Taylor Series
Limits, L'Hôpital's rule for indeterminate forms, Mean Value Theorems (Rolle's, Lagrange's MVT), Taylor/Maclaurin polynomial expansions, and single-variable extrema.
Indeterminate forms 0/0, inf/inf, 1^inf, L'Hôpital's rule, Rolle's theorem, and Lagrange's MVT average slope formula.
Taylor & Maclaurin expansions, truncation error, critical points, and first/second derivative classification tests.
Multivariable Calculus, Gradients & Hessians
Partial derivatives, gradient vectors, directional derivatives, total differential, Jacobian matrices, Hessian curvature, and unconstrained critical point classification.
Gradient vector grad(f), directional derivative D_u f = grad(f) . u, tangent hyperplanes, and Jacobian matrices.
Multivariate Taylor series, Hessian matrix H, critical points, eigenvalues, and the discriminant D = f_xx f_yy - (f_xy)^2.
Convex Sets, Functions & Lagrangian Duality
Convex sets, convex functions, first/second-order convexity criteria, Jensen's inequality, global optimality, Lagrange dual functions, weak and strong duality, and Slater's condition.
Epigraphs, first/second-order convexity conditions, Hessian PSD H >= 0, and Jensen's inequality f(E[X]) <= E[f(X)].
Lagrange dual function g(lambda, nu), concavity of dual, weak duality, strong duality, and Slater's condition.
Constrained Optimization & KKT Conditions
Equality constraints via Lagrange multipliers, geometric gradient orthogonality, Karush-Kuhn-Tucker (KKT) conditions, and complementary slackness in SVMs.
grad(f) = lambda grad(g), collinear constraint normals, shadow prices, and constrained critical points.
The Four KKT conditions: Stationarity, Primal feasibility, Dual feasibility, and Complementary slackness in Support Vector Machines.
Numerical Optimization & Gradient Dynamics
Gradient Descent updates, Lipschitz smoothness, learning rate bounds, convergence rates, condition numbers, and Newton-Raphson second-order optimization.
x_{k+1} = x_k - alpha grad(f), Lipschitz smoothness L, optimal step size alpha < 2/L, condition number kappa, and oscillations.
Newton step Delta x = - H^{-1} grad(f), quadratic convergence, scale invariance, and Hessian inversion cost.
B · GATE 2027 Syllabus Scope
Official syllabus scope and related lesson coverage; topics outside the syllabus are marked as enrichment.
- •Functions of single variable, limit, continuity and differentiability, Taylor series, maxima and minima
- •Mean value theorems (Rolle's, Lagrange's MVT, Cauchy's MVT)
- •Functions of multiple variables, partial derivatives, gradient, directional derivatives, total differential, Jacobian, Hessian matrix
- •Multivariate Taylor series, unconstrained multivariable optimization, saddle points
- •Convex sets, convex functions, quasiconvexity, Jensen's inequality, first and second order convexity conditions
- •Unconstrained optimization: Gradient Descent, learning rate, Lipschitz continuity, convergence analysis
- •Second-order optimization: Newton's method, quadratic convergence, Hessian inversion
- •Constrained optimization: Method of Lagrange multipliers, equality constraints
- •Karush-Kuhn-Tucker (KKT) conditions, complementary slackness, active and inactive constraints
- •Lagrangian duality, primal problem, dual problem, weak duality, strong duality, Slater's condition
Interactive Labs & Verified PYQs
Revision & Rapid Review Sheets
Authoritative Textbooks & Video Lectures
All notes in this notebook cross-reference standard academic literature. We do not pretend student notes substitute for classical texts — they guide you through them.
Curated lectures from verified educators (Gate Smashers, Neso Academy, Knowledge Gate, and MIT OCW) selected specifically for difficult concept visualizations.
These notes are open and maintained together.
Found a factual mistake? Have a clearer explanation or mental model? Created a useful diagram or worked out a tricky GATE question? Help make this notebook better for every student who opens it next.