Loading Events

« All Events

  • This event has passed.

CBE Seminar: “Transformer-based Hybrid Modeling and Control of Evolving, Nonlinear Processes” (Kwon, Texas A&M University)

October 25, 2023 at 3:30 PM - 4:30 PM

Traditionally, the dynamic modeling of chemical processes has relied on first-principles models grounded in fundamental physics and chemistry laws. These models, primarily formulated through differential equations with constant parameters, enable the calculation of control actions optimizing process operations, taking both process and actuator limitations into account. However, the ever-evolving and nonlinear nature of chemical processes frequently calls for models with time-varying parameters. Motivated by these challenges, we have developed hybrid models that integrate system-agnostic first-principles dynamics with system-specific data-driven, time-varying parameters. Our hybrid modeling framework incorporates a recent innovation: attention-based time-series transformers (TSTs) coupled with positional encoding. This marks a pioneering venture into applying the transformer algorithm – a cornerstone in ChatGPT’s triumph – to nonlinear, time-varying processes. By analyzing data across both current and preceding time steps, the TST captures both immediate and historical changes in process states, granting a contextual insight on process dynamics, mirroring ChatGPT’s textual context understanding. This TST-based hybrid model identifies correlations between process parameters and state variables. Its versatility is evident as it adapts to a spectrum of models – from density function theory to computational fluid dynamics -and scales, spanning from laboratory to extensive industrial environments. We will present applications of this hybrid modeling and control architecture, showcasing its utility from labs to industrial processes, made possible through partnerships with leading chemical process enterprises.

Joseph Kwon

Associate Professor of Chemical Engineering

Joseph S. Kwon is an Associate Professor in the Department of Chemical Engineering at Texas A&M University (TAMU), where he holds the esteemed Kenneth R. Hall Career Development Professorship. He earned his B.S. in Mathematics and Chemical Engineering from the University of Minnesota, Twin Cities. Subsequently, he obtained his M.S. in Electrical Engineering from the University of Pennsylvania and a Ph.D. in Chemical Engineering from University of California, Los Angeles. Dr. Kwon specializes in the development of computational models and frameworks within the field of Process Systems Engineering(PSE). His research focus encompasses multiscale modeling, hybrid modeling, model predictive control, and optimization for diverse chemical and biological process systems. He has published over 120 papers in top-tier journals, and delivered numerous invited talks at prominent chemical process entities such as ExxonMobil and Halliburton, universities, and conferences. To date, he has secured over $4 million from agencies like the NSF, DOE, as well as from private industry. He has received multiple awards, including the Hanwha Non-tenured Faculty Award, KSEA Young Investigator Award, KIChE President Young Investigator Award, and James M. Lee Memorial Award. Within TAMU, he has received the Engineering Genesis Award, TEES Young Faculty Fellow Award, and Distinguished Teaching Award from the Department of Chemical Engineering. Additionally, he has secured best paper awards from both the IET Systems Biology Journal and the Mathematics Journal.


October 25, 2023
3:30 PM - 4:30 PM
Event Category:
Event Tags:


Chemical and Biomolecular Engineering
View Organizer Website


Wu and Chen Auditorium (Room 101), Levine Hall
3330 Walnut Street
Philadelphia, PA 19104 United States
+ Google Map
View Venue Website