This Is AuburnElectronic Theses and Dissertations

Show simple item record

Applications of Stochastic Gradient Descent for Optimization of Complex Systems with Uncertainty


Metadata FieldValueLanguage
dc.contributor.advisorvan Wyk, Hans Werner
dc.contributor.authorDas, Somak
dc.date.accessioned2021-07-27T15:32:16Z
dc.date.available2021-07-27T15:32:16Z
dc.date.issued2021-07-27
dc.identifier.urihttps://etd.auburn.edu//handle/10415/7872
dc.description.abstractThe Stochastic Gradient Descent (SGD) method in all its variations has gained popularity with the recent progress in Machine learning. In this dissertation we implement and analyze two modifications of the SGD method. In the first half of the dissertation we investigate the adaptive gradient descent (AdaGrad) method in the context to the optimal distributed control of parabolic partial differential equations with uncertain parameters. This stochastic optimization method achieves an improved convergence rate through adaptive scaling of the gradient stepsize. We prove the convergence of the algorithm for this infinite dimensional problem under suitable regularity, convexity, and finite variance conditions, and relate these to verifiable properties of the underlying system parameters. Finally, we apply our algorithm to the optimal thermal regulation of lithium battery systems under uncertain loads. In the second half of the dissertation we look at the design, implementation and analysis of Stochastic Alternating Least Squares (SALS) as a method that approximates the canonical decomposition of averages of sampled random tensors. Its simplicity and efficient memory usage make SALS an ideal tool for decomposing tensors in an online setting. We show, under mild regularization and readily verifiable assumptions on the boundedness of the data, that the SALS algorithm is globally convergent. Numerical experiments validate our theoretical findings and demonstrate the algorithm’s performance and complexity.en_US
dc.subjectMathematics and Statisticsen_US
dc.titleApplications of Stochastic Gradient Descent for Optimization of Complex Systems with Uncertaintyen_US
dc.typePhD Dissertationen_US
dc.embargo.statusNOT_EMBARGOEDen_US
dc.embargo.enddate2021-07-27en_US
dc.contributor.committeeCao, Yanzhao
dc.contributor.committeeGlotov, Dmitry
dc.contributor.committeeNane, Erkan
dc.contributor.committeeOeding, Luke
dc.contributor.committeeZhou, Yang

Files in this item

Show simple item record