Research Interests and Directions
My research focuses on variational functionals and partial differential equation (PDE)-based models which can be applied to practical problems, such as
- 1 . Mathematical image and signal processing, and data clustering
- 2 . Differential equation identification and Numerical approximation
- 3 . Math Biology application and 4. Path planning
Identifying Differential Equation from Data Top
Can we identify differental equation from a given single set of data using numerical methods ?
We explore a new direction of problem, where real physical phenomenon is captured by different digital devices, and we identify the underlying governing differential equations to help understand the phenomenon. Identifying unknown differential equations from a one given set of discrete time dependent data is a challenging problem. A small amount of noise can make the recovery unstable, Nonlinearity and varying coefficients add complexity to the problem.
We explore how far we can identify using numerical techniques.
WeakIdent can identify PDEs and ODEs. This example shows identifying ODEs: from the given data (red), green curve is generared from the identified differential equation. WeakIdent is stable againt high level of noise, and give accurate recovery.
- Sung Ha Kang, Wenjing Liao, and Yingjie Liu, ``IDENT: Identifying Differential Equations with Numerical Time evolution", ArXiv:1904.03538, Journal of Scientific Computing, 87, 1 (2021)
We propose using time evolution and base expension. - Yuchen He, Sung-Ha Kang, Wenjing Liao, Hao Liu and Yingjie Liu, ``Robust Identification of Differential Equations by Numerical Techniques from a single set of noisy observation (Robust IDENT from a single set of noisy observation)",arXiv:2006.06557, SIAM Journal on Scientific Computing, 44 (3), 1145-A1175 (2022)
We propose Successively Denoised Differentiation (SDD) for denoising, Subspace Pursuit for sparse recovery, and multishooting time evolution and cross validation for identification. - Yuchen He, Sung-Ha Kang, Wenjing Liao, Hao Liu and Yingjie Liu, ``Numerical Identification of Nonlocal Potentials in Aggregation", Communications in Computational Physics, 32, pp. 638-670, (2022).
We identify the potential from a single noisy spatial-temporal process, using minimizing regularized functional. - Yuchen He, Namjoon Suh, Xiaoming Huo, Sung Ha Kang, and Yajun Mei, ``Asymptotic Theory l1-Regularized PDE Identification from a Single Noisy Trajectory", SIAM ASA Journal on Uncertainty Quantification, Vol 10, Iss.3, (2022).
We explore asymptotic theory for the support recovery from a single noisy trajectory using l 1 regularized Pseudo-Least Squares model. - Mengyi Tang, Wenjing Liao, Rachel Kuske,and Sung Ha Kang, ``WeakIdent: Weakformulationfor Identifying Differential Equations using Narrow-fit and Trimming", Journal of Computational Physics, accepted March 2023.
We propose Weak form approach for identification of differential equation. - Yuchen He, Sung-Ha Kang, Wenjing Liao, Hao Liu and Yingjie Liu, ``Group projected Subspace Pursuit for Identification of variable coefficient differential equations (GP-IDENT)", Journal of Computational Physics, Volume 494, 1 December 2023.
We propose a method to recover space and time varying coefficient using Group projects Subspace Pursuit. - Mengyi Tang, Hao Liu, Wenjing Liao and Sung Ha Kang, ``Fourier features for Identifying Differential Equations (Fourier Ident)", (arXiv:2311.16608), submitted 2024
Regularized k-means Clustering and applications **************************************************
How to automatically cluster the given data without knowing the number of clusters ?
Extending from unsupervise segmentation model, we explore data clustering. We explore parallel algorithm using regularized k-means, and this method is able to find changing number of clusters as more data streams and the characteristic changes.
- Benjamin McLaughlin and Sung Ha Kang, "A new parallel adaptive clustering and its application to streaming data", Journal of Computational Science, Volume 66, January 2023. (arXiv:2104.02680)
- Sung Ha Kang, Berta Sandberg, and Andy Yip, A Regularized K-means and Multiphase Scale Segmentation ", Inverse Problems and Imaging, Volume 5, Issue 2, Pages 407-429, 2011.
As data classification changes in time, the proposed parallel method can automatically cluster (even as the cluster number changes). At the start there were only one cluster. As more data are added, this method automatically finds two clusters or more as the cluster changes.
Mathematical Image Processing Top
There are many interesting imaging problem, such as image denoising, deblurring, color image analysis, multiphase segmentation and others. The following shows some of such examples using variational and PDE based model osved by various numerical methods.
-
Image Vectorization **************************************************
- Yuchen He, Sung Ha Kang, and Jean-Michel Morel, ``VIVA: A Variational Image Vectorization Algorithm on Dual-Primal Graph Pairs", 2023 IEEE International Conference on Image Processing (ICIP), October 8-11, 2023.
- Yuchen He, Sung Ha Kang, and Jean-Michel Morel, ``Topology and perception aware image vectorization", Journal of Mathematical Imaging and Vision, Volume 65, pages 874 - 893, 2023.
- Yuchen He, Sung Ha Kang, Jean-Michel Morel, ``Vectorizing images of any size", 2022 IEEE International Conference on Image Processing (ICIP), October 2022.
- Yuchen He, Sung Ha Kang, Jean-Michel Morel, ``Silhouette Vectorization by Affine Scale-space", arXiv:2007.12117, Journal of Mathematical Imaging and Vision, 64, 41 - 56, (2022).
- Yuchen He, Sung Ha Kang, Jean-Michel Morel, ``Accurate Silhouette Vectorization by Affine Scale-Space", 2021 IEEE International Conference on Image Processing (ICIP), Septermber 19-22, 2021.
- Yuchen He, Sung Ha Kang, Luis Alvarez, ``Finding the skeleton of 2D shape and contours: implementation of Hamilton-Jacobi Skeleton", Image Processing On Line, 11 (2021), pp. 18--36. https://doi.org/10.5201/ipol.2021.296
- Yuchen He, Sung Ha Kang, and Hao Liu, ``Curvature Regularized Surface Reconstruction from Point Cloud", ArXiv:2001.07884, SIAM Journal on Imaging Sciences 13(4), 1834-1859 (2020).
- Sung Ha Kang, Xuecheng Tai and Wei Zhu, ``Survey of geometry inspired variational segmentation: interface model, curvature terms and fast computation", Handbook of Numerical Analysis, Elsevier, Volume 20, 2019.
- Maryam Yashtini and Sung Ha Kang, ``A fast relaxed normal two split method and an effective weighted TV approach for Euler's Elastica image inpainting", SIAM Journal of Imaging Science, (2016)
We propose two fast algorithm for Elastica based image inpainting. - Maryam Yashtini and Sung Ha Kang, ``Alternating Direction Method of Multiplier for Euler's Elastica-Based Denoising", International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), Pages 690-701, 2015.
Fast algorithm for Elastica-Based Denoising. - Sung Ha Kang, Wei Zhu and Jackie Shen, ``Illusory Shapes via Corner Fusion", SIAM Journal of Imaging Science, Volume 7, Number 4, Pages 1907-1936, 2014.
This model proposed a new approach for Illusory and occluded shape reconstruction using the Corner base. This work uses G-convergence approach for Elastica energy minimization. - Tony Chan, Sung Ha Kang and Jianhong Shen, ``Euler's Elastica and Curvature Based Inpaintings" , SIAM journal on Applied Mathematics, 63, number 2, page 564-592, 2002. Preprint at UCLA CAM01-12
This is one of the earlier works successfully implementing functionals with Euler's Elastica term, one of the natural ways to improve the TV inpainting method. - Yaghoub Rahimi, Sung Ha Kang and Yifei Lou, ``A lifted l1 framework for sparse recovery", Information and Inference: A Journal of the IMA, Volume 13, Issue 1, March 2024 (arxiv:2203.05125)
- Mengyi Tang, Maryam Yashtini and Sung Ha Kang, ``Counting Objects by Diffused Index: geometry-free and training-free approach", Journal of Visual Communication and Image Representation, Volume 86, July 2022
- Maryam Yashtini, Sung Ha Kang, and Wei Zhu, ``Efficient Alternating Minimization Methods For Variational Edge-weighted Colorization Models", Advances in Computational Mathematics, 45, pages1735 -- 1767 (2019)
- Yuchen He, Martin Huska, Sung Ha Kang, and Hao Liu, ``Fast Algorithms for Surface Reconstruction from Point Cloud", ArXiv: 1907.01142, In the proceedings of the International Workshop on Image Processing and Inverse Problems (IPIP 2018) (Springer), pages 61-80, (2018)
- Jean-Francois Aujol and Sung Ha Kang, ``Color Image Decomposition and Restoration", Journal of Visual Communication and Image Representation , Volume 17, Number 4, pages 916-928, 2006. Full color images available at: UCLA CAM04-73.
We proposed one of the first models on color image texture decomposition, where the G-norm for color image was defined as the polar semi norm associated to the 3D total variation semi norm. - Martin Huska, Sung Ha Kang, Alessandro Lanza, and Serena Morigi, ``A Variational Approach to Additive Image Decomposition into Structure, Harmonic and Oscillatory Components", SIAM Journal on Imaging Sciences, 14 (4), 2021.
- Antonio Cicone, Martin Huska, Sung-Ha Kang and Serena Morigi, ``JOT: a Variational Signal Decomposition into Jump, Oscillation and Trend", IEEE Transactions on Signal Processing, 70, 772-784, 2022.
- Martin Huska, Antonio Cicone, Sung Ha Kang, and Serena Morigi, "A two-stage signal decomposition into Jump, Oscillation and Trend using ADMM", IPOL 2023.
- Ho Mark Law, Guangyu Cui, and Sung Ha Kang, ``Surface Reconstruction from 2D Noisy Point Cloud Data using Directional G-norm", SSVM 2023.
- Yuchen (Roy) He, and Sung Ha Kang, ``Lattice Identication and Separation: Theory and Algorithm" (LISA), SIAM Journal on Imaging Sciences, 12(4), 2063 -- 2096, 2019 (ArXiv:1901.02520).
- Yuchen (Roy) He, and Sung Ha Kang, ``Lattice Metric Space Application to Grain Defect Detection", the proceedings of the 7th International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2019.
- Sung Ha Kang, Behrang Shafei and Gabriele Steidl, ``Supervised and Transductive Multi-Class Segmentation Using p-Laplacians and RKHS Method", Journal of Visual Communication and Image Representation, Volume 25, Issue 5, Pages 1136-1148, July 2014.
- Sung Ha Kang and Riccardo March, ``Existence and regularity of minimizers of a functional for unsupervised multiphase segmentation ", Nonlinear Analysis Series A: Theory, Methods and Applications, Volume 76, Pages 181-201, 2013
- Berta Sandberg, Sung Ha Kang, and Tony F. Chan, ``Unsupervised Multiphase Segmentation: A phase balancing model", IEEE Transaction on Image Processing, Volume 19, Issue 1, Pages 119 - 130, 2010. Preprint available at: UCLA CAM08-02.
Different from the case of two-phase identification, multiphase case has sensitivity issues: choosing an initial condition and pre-assigning the number of phases before the segmentation is performed. These issues of automatic choice of the number of phase k and sensitivity are addressed by unsupervised model. - Frank Crosby and Sung Ha Kang, ``Multiphase Segmentation for 3D Flash Lidar Images", Journal of Pattern Recognition Research, Volume 6, Number 2, Pages 193-200, 2011.
- Marco Barchiesi, Sung Ha Kang, Triet Le, Massimiliano Morini, Marcello Ponsiglione, ``A variational model for infinite perimeter segmentations based on Lipschitz level set functions: denoising while keeping finely oscillatory boundaries", Accepted SIAM Multiscale Modeling and Simulation 2010.
We proposed a new model of image segmentation which captures the oscillatory boundary while denoising the image. A typical segmentation model uses the total length penalization regularization, and this term is replaced by the area of the boundary neighborhood in the new model. The objective is to keep fine details and irregularities of the boundaries while denoising additive Gaussian noise. This is an initiating work on capturing the fine details of the boundary in image segmentation problem.
(a) Given noisy image. (b) and (c) are segmentation results this model, where Minkowski content is used in place of the typical total length term. With a different choice of parameters, one can segment the image similar to that of piecewise constant Mumford-Shah model (b) or capture more details of the boundary as in (c).This model allows the boundary with infinite perimeter, as long as it can be included in the epsilon bound.
Image Segmentation and Phase Transistion **************************************************
Using a well-potential is frequently studied in material science problems of phase transition, which has recently been introduced to imaging applications. These connections between phase transition model and image segmentation are quite natural: the phases in material sciences are characterized by densities and tensions, while in imaging object segments are characterized by some key visual features such as intensities and orientations.
- Yoon Mo Jung , Sung Ha Kang and Jianhong Shen, `` Multiphase image segmentation via Modica-Mortola phase transition", SIAM Journal on Applied Mathematics, Volume 67, Issue 5, Pages 1213-1232, 2007.
- Sung Ha Kang and Riccardo March, ``Multiphase image segmentation via equally distanced multiple well potential", Journal of Visual Communication and Image Representation, Volume 25, Issue 6, Pages 1446--1459, 2014.
- Tony Chan, Sung Ha Kang and Jianhong Shen, `` Euler's Elastica and Curvature Based Inpaintings ", SIAM journal on Applied Mathematics, 63, number 2, page 564-592, 2002. Preprint at UCLA CAM01-12
This is one of the earlier works successfully implementing functionals with Euler's Elastica term, one of the natural ways to improve the TV inpainting method. - Sung Ha Kang, Tony Chan and Stefano Soatto,``Inpainting from Multiple view'', Proceedings of first international symposium on 3D Data Processing Visualization Transmission, Pages 622-625, 2002. ( UCLA CAM 02-11 )
This model handles very large missing regions, which is typically not solvable with typical local inpainting methods.
Full details and images are at UCLA CAM02-31, ``Landmark based inpainting from Multiple view'', March 2002 - Tony F. Chan and Sung Ha Kang, `` Error Analysis for Image Inpainting'', Journal of Mathematical Imaging and Vision, Volume 26, pages 85-103, 2006.
(full color images
available at: UCLA CAM 04-72).
This is the first work on error analysis for image inpainting. For general inpainting experiments, local inpainting methods work well for narrow inpainting domains, and the error bounds give analysis on this phenomenon.
Color analysis and Colorization**************************************************
- Tony. F. Chan, Sung Ha Kang and Jianhong Shen, ``Total Variation Denoising and Enhancement of Color Images Based on the CB and HSV Color Models", Journal of Visual Communication and Image Representation, 12: 422-435, 2001. Full color images available at: UCLA CAM00-25.
Study of different color space including Chromaticity-Brightness (CB) and Hue-Saturation-Value (HSV). - Sung Ha Kang and Riccardo March, ``Variational models for image colorization via Chromaticity and Brightness decomposition", IEEE Transaction on Image Processing, Volume 16, Issue 9, Pages 2251-2261, 2007. Full color images available at
IMA preprint 2138, October 2006
Colorization refers to recovering color of gray scale images when only small regions with color are given. The term ``colorization" was introduced by Wilson Markle who first processed the gray scale moon image from the Apollo mission. We proposed a couple of variational models using chromaticity color component to colorize black and white images. These proposed models are true to the objective of smooth color recovery and the convergence analysis backs up the successful numerical results. The image decomposition is applied in addition for texture colorization. - Triet Le , Minh Ha Quang and Sung Ha Kang, ``Reproducing kernel and colorization", Proceedings of the 8th International Conference on Sampling Theory and Applications (SAMPTA 09), May 2009.
- Minh Ha-Quang, Sung-Ha Kang, and Triet M. Le, ``Image and Video Colorization Using Vector-Valued Reproducing Kernel Hilbert Spaces ", Journal of Mathematical Imaging and Vision, Volume 37 , Issue 1, Pages: 49 - 65, 2010. Preprint available at UCLA CAM09-46
The setting of RKHS and its extensions are widely considered in machine learning. We proposed the first work applying RKHS framework to image and video colorization, and the vectorial settings of RKHS are analyzed. - Sung Ha Kang, Behrang Shafei and Gabriele Steidl, "Supervised and Transductive Multi-Class Segmentation Using p-Laplacians and RKHS Method",Journal of Visual Communication and Image Representation, Volume 25, Issue 5, Pages 1136-1148, July 2014. Preprint available here.
- Sung Ha Kang and Jianhong Shen, ``Video dejittering by Bake and Shake", Image and Vision Computing, Volume 24, Issue 2, Pages 143-152, 2006. Full color images available at UCLA CAM 04-60.
Image and Video Dejittering occurs when the horizontal lines of video image frames are randomly displaced due to the corruption of synchronization signals or electromagnetic interference during video transmission. This method gives very robust numerical results. - Jianhong Shen and Sung Ha Kang, ``Quantum TV and Applications in Image Processing", Inverse Problems and Imaging, Volume 1, Number 3, Pages 557-575, 2007. Preprint UCLA CAM07-09
This work is on a discrete version of total variation minimizing computation using stochastic/Markovian gradient descent method. - Sung Ha Kang and Jianhong Shen, ``On the slicing moments of BV functions and applications to image dejittering", Image Processing Based on Partial Differential Equations, Springer-Verlag, Berlin, Pages 35-55, 2007. Preprint UCLA CAM 05-11
This method allows to recover even a very thin lines which was impossible from previous dejittering methods. - James H. Money and Sung Ha Kang, ``Total variation semi-blind
deconvolution using shock filters", Image and vision computing, Volume 26, Issue 2, Pages 302-314, 2008. Preprint IMA preprint 2106, March 2006.
Image deblurring is one of the classical but difficult problems due to its ill-posedness. The objective is to recover out-of-focus images. A blurry image is typically assumed to be generated via Gaussian kernel convoluted with the original image. We propose a method which is free from assumptions on the type of a blur kernel. This methos can also capture a motion blur. - Yifei Lou, Sung Ha Kang, Stefano Soatto and Andrea Bertozzi, ``Video Stabilization of Atmospheric Turbulence Distortion", Inverse Problems and Imaging, Volume 7, Issue 3, 2013. Preprint available at UCLA CAM 12-30
- Mengyi Tang, Kumbit Hwang and Sung Ha Kang, "StemP: A fast and deterministic Stem-graph approach for RNA secondary structure prediction", IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2023.
- Mathematical modeling of Single Germinal Center (In preparation)
We propose a mathematical model for B cell affinity maturation during a life cycle of a single germinal center. - Sung Ha Kang, Seong Jun Kim, and Haomin Zhou, ``Path optimization with limited sensing ability (POLSA)", Journal of Computational Physics , Volume 299, 15, October 2015, Pages 887- 901. (UCLA CAM 14-99)
- Sung Ha Kang, Seong Jun Kim, and Haomin Zhou,``Optimal Sensor Positioning (OSP); A Probability Perspective Study", SIAM Journal on Scientific Computing , 39(5), 759-777, 2017
- Acceleration based path planning and multi-agent model (Haodong Sun's Thesis)
Vectorization refers to converting pixelwise bitmap information to scalable vector image files, which allows easy manipulation of image, e.g., scale changes, without loss of image quality. Mathematical exploration can make a big impact in computer graphics community. We proposed a mathematically founded silhouette vectorization approach.
An exmaple from Silhouette Vectorization: from pixelized image (a), vectorization gives scalable SVG image in (h), which can represent any resolution.
Curvature based variational models **************************************************
Curvature is one of the fundamental properties in understanding curves and level lines. Using curvature, there are many interesting application one can explore, such as inpainting, illusory contours, following human vision perception. However, computation and analysis remain to be challenging. In the following, application to point cloud reconstruction, survey of variational models with curvature terms, fast algorithms, illusory countor and inpainting application are presented.
An exmaple of using curvature regularized surface reconstruction from point cloud.
(a) without curvature constraint and (c) with curvature constraint.
An exmaple from illusory shapes. From given image (a), illusory object is recovered in (b) and occluded objects in (c).
Fast algorithms for imaging and applications **************************************************
Image and Signal Decomposition **************************************************
The given signal in left (blue) is decomposed to piecewise constant, shades and noise.
The given signal in left (blue) is decomposed to Jump, Oscillation and Trend: using non-convex term for piecewise constant component, harmonic norm for smooth component, and G-norm for noise component.
Lattice identification **************************************************
Motivated by the problems of lattice mixture identification and grain irregularity detection in material science research, we developed a framework for lattice pattern representation and comparison and propose an efficient algorithm for lattice separation. We define new scale and shape descriptors, which considerably reduce the size of equivalence classes of lattice bases.
Lattice is characterized in this paper and Lattice comparison measure is introduced. This allows to distinguish lattics mixture. The given lattice mixture can be separated to three separate lattics patterns.
Grain regions can be Lattice is characterized in this paper and Lattice comparison measure is introduced. This allows to distinguish lattics mixture. The given lattice mixture can be separated to three separate lattics patterns.
Multiphase segmentation **************************************************
This model automatically chooses a reasonable number of phases (with mu=1) as it segments the image via the minimum of the following functional. This functional has interesting properties such as giving balance among different phases, good detail recoveries, flexibilities allowed by the choice of parameter and applications to image quantization and others. (In the right, two images show the effects of having a different choice of the parameter.)
We proposed a model built upon Modica-Mortola phase transition that represents each segment by an integer. With a single function z, the computation becomes quite simple and multiple phases are naturally found by the minimum (wells) of the functional. These studies are closely related to calculus of variation and analysis, and these studies also provide practical and realistic applications of such theoretical models.
In the following work, we propose equally distanced multiple well potential which gives non-weighted length minimization.
Image Inpainting **************************************************
Deblurring, dejittering and quantization**************************************************
(a) One frame from the original. (e) The temporal mean of the deblured frames showing straight lines. (f) Using the proposed model with image fusion showing more clear details.
Math Biology problems Top
We propose a new deterministic methodology to predict the secondary structure of RNA sequences. The proposed simple deterministic algorithm uses minimum stem length, Stem-Loop score, and co-existence of stems, to give good structure predictions for short RNA and tRNA sequences. The proposed method can predict secondary structure even with pseudo knots. One of the strengths of this approach is the simplicity and flexibility of the algorithm, and it gives a deterministic answer. (Code available on Github.)
The flow chart of the proposed stemP algorithm.
Example of RNA prediciton using the proposed StemP algorithm shown in (c).
Path planning Top
The POLSA example: (a) Initial path. (b) The resulting optimal path (also disentangled). The length reduced from 10.587 to 5.322, and the number of connecting points is reduced to 13.