Publications
Publications on Imaging, Vision, and Signals
(Imaging Science and Visual Intelligence; Signals & Patterns; Multiscale, Stochastic, & PDE Methods)
§1. Vision Modeling, Analysis, and Computing (ViMAC):
Neural, Cognitive, and Pattern-Theoretic
[Cognition and Perception] Yoon Mo Jung and Jianhong (Jackie) Shen, Illusory shapes via first-order phase transition and approximation, J. Math. Imaging Vision, 53(3):303-313, 2015. A Sample Figure.
[Keywords: Illusory shape; phase transition; null hypothesis; iterative algorithm; convergence analysis]
[Cognition and Perception] Sung Ha Kang, Wei Zhu, and Jianhong (Jackie) Shen, Illusory shapes via corner fusion, SIAM J. Imaging Sci., 7(4):1907-1936, 2014. A Sample Figure.
[Keywords: Illusory shape; corner base; local cue; elastica fusion; phase transition; variational optimization; ghost shape]
[Cognition and Perception] Yoon-Mo Jung and Jianhong (Jackie) Shen, First-order modeling and stability analysis of illusory contours, J. Visual Commun. Image Representation, 19:42-55, 2008. A sample figure.
A sample movie for Kanizsa Triangle. (via the level-set method of Osher and Sethian; See video below.)
[Keywords: illusion, illusory contours, energy model, local stability, contour decomposition, real and imaginary, kinks, spans, turns, level-set method, supervision]
Most closely related works on modeling illusory contours: Sarti, Malladi, and Sethian (Berkeley) and Zhu and Chan (UCLA).
[Oscillatory & Singular Patterns] Jianhong (Jackie) Shen, Beamlets are densely embedded in H -1, Adv. Comput. Math., 31:329-348, 2009. The PDF file. A sample figure.
[Keywords: texture, distribution, oscillation, singular Radon measure, beamlets, isoperimetric inequality, Haar molecules, Haar potentials]
Two works having directly inspired ours: Donoho and Huo's (Stanford) beamlets and Osher, Sole, and Vese's (UCLA) H-1 texture.
[Perception vs. Printing Technology] Jianhong (Jackie) Shen, Least-square halftoning via human vision system and Markov gradient descent (LS-MGD): Algorithm and analysis, SIAM Review, 51(3):567-589, 2009. The PDF file. A sample figure.
[Keywords: Halftoning, Human Vision System (HVS), mixing, entropy, least square, stochastic gradient descent, Markov random walk, random fields, Bernoulli flipping, convergence analysis, blue noise]
See related works on Analog/Digital signal conversion by Ingrid Daubechies (Princeton) and Sinan Güntürk (Courant), et al.
Substantially consolidates our earlier PDE-stochastic model/algorithm based on Perona-Malik diffusion and stochastic flipping.
[Material Science vs. Visual Perception] Yoon-Mo Jung, Sung-Ha Kang, and Jianhong (Jackie) Shen, Multiphase image segmentation by Modica-Mortola phase transition, SIAM J. Appl. Math., 67(5):1213-1232, 2007. The PDF file. A sample figure.
[Keywords: Multiphase, segmentation, Mumford-Shah, phase transition, Gamma-convergence, Modica-Mortola, integer progamming, convex splitting/convex-concave procedure (CCCP). ]
[Pattern Mixture and Separation] Jianhong (Jackie) Shen, A stochastic-variational model for *soft* Mumford-Shah segmentation, Int'l J. Biomedical Imaging, vol. 2006, Article ID 92329, 2006 (Open Access).
The PDF file from nih.gov. A sample figure. Another sample of a brain image.
[Keywords: soft vs. hard, Mumford-Shah, pattern, ownership, probability simplex, Modica-Mortola, phase-field, Egorov's theorem, Poincaré inequality, existence theorems, AM algorithm]
For stochastic researchers less familiar with variational-PDE's: could treat the work as geometrically regularized K-Mean Clustering and Mixture Gaussians.
[Pattern Synthesis and Analysis] Jianhong (Jackie) Shen, Piecewise H-1+H0+H1 images and the Mumford-Shah-Sobolev model for segmented image decomposition, Applied Math. Research Exp., 4: 143-167, 2005. A sample figure.
[Keywords: vision, patterns, synthesis vs. analysis, segmentation, decomposition, variational, free boundary, textures, wavelength, mathematical modeling of painting and artists]
[Unified Modeling & Algorithms] Tony F. Chan and Jianhong Shen, Theory and computation of variational image deblurring, IMS (Inst. Math. Sci., Singapore) Lecture Notes Series, "Mathematics and Computation in Imaging Science and Information Processing," World Scientific Publishing Co., 2007. The PDF file.
[Note: 2003/04 preprint revised; new: stochastic signals, Bayesian approach to Wiener filtering, iterated wavelet-shrinkage algorithm of Daubechies et al.]
See the remarkable comprehensive review closely related to ours by three astrophysicists: Puetter, Gosnell, and Amos Yahil (Stony Brook).
[Generative Pattern Modeling] Jianhong Shen, On the foundations of vision modeling III. Noncommutative monoids of occlusive preimages. J. Math. Imaging Vision, 24:5-17, 2006. Two sample preimages.
[Keywords: Depth, occlusion, segmentation, preimages, monoids (semi-groups), noncommutativity, topology, invariants, knot theory]
Segmentation has been universally treated as an INVERSE problem. But has anyone ever come up with a sound FORWARD problem? Is this really a trivial matter? See also the Review by Dr. Jonathan Hodgson in ACM's "Computing Reviews"
[Geometric Pattern Detection] Jianhong Shen, On the foundations of vision modeling II. Mining of mirror symmetry of 2-D shapes , J. Visual Commun. Image Rep., 16(3), pp. 250-270, 2005.
[Keywords: Mirror symmetry, principle component analysis (PCA), Lebesgue, Hausdorff, features, existence, convex shape, support function, normal shooting algorithm]
[Psychophysics into Modeling] Jianhong Shen, On the foundations of vision modeling I. Weber's law and Weberized TV (total variation) restoration , Physica D: Nonlinear Phenomena , 175(3/4), pp. 241-251, 2003.
[Thank my dear teachers and friends in vision psychology, psychophysics, and computation here at UMN: Dan Kersten and Paul Schrater.]
[Psychophysics and Quantum Physics] Jianhong Shen and Yoon-Mo Jung, Weberized Mumford-Shah model with Bose-Einstein photon noise, Appl. Math. Optim., 53(3):331-358, 2006. (Here to the journal.) The PDF file.
[Keywords: Weber's Law, light adaptivity, retina, Mumford-Shah, segmentation, Bose-Einstein statistics, Gamma-convergence]
[Biochemical Turing Patterns] Jianhong Shen and Yoon-Mo Jung, Geometric and stochastic analysis of reaction-diffusion patterns , Int'l J. Pure Applied Math., 19(2):195-248, 2005. The PDF file.
[Keywords: data mining, pattern, Turing instability, reaction, diffusion, entropy, skewness, kurtosis, isoperimetric ratio, curvature measure.]
contour07.mpgMVpathfinder.mpg§2. Image/Signal Processing & Analysis (iSPA):
Variational-PDE, Bayesian/Stochastic, and Wavelet Methods
[Unified Models/Algorithms for Quantization/Segmentation] Jianhong (Jackie) Shen and Sung Ha Kang, Quantum TV and Applications in Image Processing, Inverse Problems and Imaging, 1(3):557-575, 2007. The PDF file.
[Keywords: quantization, quantum, quanta set, TV (total variation), discrete programming, Markov gradient descent, maximum likelihood, geometric, photometric, segmentation.]
[Invited Book Review] Jackie (Jianhong) Shen, Invited book review for Deblurring Images--Matrices, Spectra, and Filtering, by Christian Hansen, James G. Nagy, and Dianne P. O'Leary, by SIAM Publisher (2006). Math. Comput., 76: 2256-2258, 2007. The PDF file for the Review.
Sung-Ha Kang and Jianhong (Jackie) Shen, Image Dejittering Based on Slicing Moments, in Image Processing Based on Partial Differential Equations, pp. 35-55, Springer Series on Mathematics and Visualization ," Springer, 2007. The PDF file. A sample image.
[Keywords: BV functions, slicing moments, codimension, inverse problem, Bayesian, regularization, dejitter, existence, uniqueness.]
Sung-Ha Kang and Jianhong Shen, Video Dejittering by Bake and Shake, (UCLA Math CAM Tech. Report 04-60) Image and Vision Computing , 24(2): 143-152, 2006. A sample image.
[Keywords: Line jitteers, Perona-Malik, bake, edge adaptive, total variation, PDE method, Newton-Raphson, shake]
Tony F. Chan and Jianhong Shen, Variational Image Inpainting, Comm. Pure Applied Math., vol. LVIII, pp. 579-619, 2005. Click here to go to the journal article
Jianhong (Jackie) Shen, Progressive Halftoning by Perona-Malik Error Diffusion and Stochastic Flipping, Proc. SPIE on Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning, vol. 6064, pp. 0301-0313, 2006. The PDF file.
[Keywords: Halftone, sigma-delta, error diffusion, Perona-Malik, stochastic flipping, blue noise, random fields, parallel computing] [ Thanks go to Ingrid Daubechies (Princeton), Sinan Güntürk (Courant), and Chai Wah Wu (IBM) ]
Also click here for a one-page invited letter exclusively for SPIE's Electronic Imaging Newsletter, vol. 16, No. 2, page 6, 2005. [ Special thanks to Dr. Gabriel Marcu at the Apple Computer, Inc.]
Tony F. Chan, Jianhong Shen, and Hao-Min Zhou, Total Variation Wavelet Inpainting, UCLA Comp. Appl. Math. (CAM) Tech. Report 04-47 (pdf), 2004. J. Math. Imag. Vision, 25(1):107-125, 2006. Click here for a JPEG sample.
[Keywords: error concealment, JPEG2000, loss, wavelets, total variation, BV space, Besov, geometry, existence, uniqueness, Bayesian]
Jianhong (Jackie) Shen, Γ-Convergence Approximation to Piecewise Constant Mumford-Shah Segmentation, J. Blanc-Talon et al. (Eds.): ACIVS 2005 (Int'l Conf. Advanced Concepts Intell. Vision Systems), Lec. Notes Comp. Sci. 3708 , pp. 499-506, 2005.
Click here for a mpeg movie (the Pathfinder) (Also see the video above), The final PDF file (8-page limit).
[Keywords: Mumford-Shah segmentation, Gamma convergence, Ginzburg-Landau, phase field approximation, Poisson equation.]
J. Shen, Bayesian video dejittering by the BV image model, SIAM J. Appl. Math., 64(5), pp. 1691-1708, 2004. Click here to visit SIAM.
Jianhong Shen, Inpainting and the fundamental problem of image processing, SIAM News, 36(5), June 2003. (Invited unrefereed survey article for the entire community of applied mathematicians.)
Related recent work by Smale and Zhou, on sampling and learning theory, Bulletin of the AMS , 2004.
Interesting tie to digital watermarking by Flesia and Donoho on the theory of digital watermarking, 2003.
Tony F. Chan, Jianhong Shen, and Luminita Vese, Variational PDE models in image processing, Notices Amer. Math. Soc. , 50, pp. 14-26, January 2003.
T. F. Chan and J. Shen, On the role of the BV image model in image restoration, Amer. Math. Soc. Contemp. Math., vol. 330, pp. 25-41, 2003.
Tony F. Chan, Sang-Ha Kang and Jianhong Shen, Euler's elastica and curvature-based image inpainting, SIAM J. Appl. Math., 63(2), pp. 564-592, 2002.
T. F. Chan and J. Shen, Inpainting based on nonlinear transport and diffusion, in Inverse Problems, Image Analysis, and Medical Imaging, Ed. Z. Nashed and O. Scherzer, Amer. Math. Soc. Contemp. Math., 313, pp. 53-65, 2002. (Research paper refereed by three referees.)
J. Shen, Geometric image inpainting and applications, Proc. SPIE, vol. 4792, pp. 102-113, 2002. (Refereed conference research paper for the associated invited talk at SPIE's 47th annual meeting, Seattle, July 2002. Note: SPIE=Int'l Society of Optical Engineering.)
Selim Esedoglu and J. Shen, Digital inpainting based on the Mumford-Shah-Euler image model, European J. Appl. Math., 13, pp. 353-370, 2002.
T. F. Chan and J. Shen, Bayesian inpainting based on geometric image models, Recent Progress in Computational & Applied PDEs, Kluwer Academic, pp. 73-98, 2002. (Refereed conference research paper.)
J. Shen, The Mumford-Shah digital filter pair (MS-DFP) and applications, 2002 IEEE Int'l Conf. Image Proc., 2, pp. 849-852, 2002. (Refereed conference research paper.)
T. F. Chan and J. Shen, Mathematical models of local non-texture inpaintings, SIAM J. Appl. Math., 62(3), pp. 1019-1043, 2001.
T. F. Chan and J. Shen, Non-texture inpainting by curvature-driven diffusions (CDD), J. Visual Comm. Image Rep., 12(4), 436-449, 2001.
T. F. Chan, S.-H. Kang, and J. Shen, Total variation denoising and enhancement of color images based on the CB and HSV color models, J. Visual Comm. Image Rep., 12(4), pp. 422-435, 2001.
T. F. Chan and J. Shen, PDE models for image inpaintings and applications, Proc. Int'l Conf. Imaging Sci. Sys. Tech.'2001, pp. 30-36, Ed. H. R. Arabnia, 2001. (Refereed conference research paper.)
T. F. Chan, S. Osher, and J. Shen, The digital TV filter and nonlinear denoising, IEEE Trans. Image Process., 10(2), pp. 231-241, 2001.
T. F. Chan and J. Shen, Restoration of non-flat image features: models and algorithms, SIAM J. Appl. Math., 61(4), pp. 1338-1361, 2000.
Stanley Osher and Jianhong Shen, Digitized PDE method for data restoration, in Analytical-Computational Methods in Applied Mathematics, Ed. G. A. Anastassiou, pp. 751-771, Chapman & Hall/CRC, FL, 2000.
Jianhong Shen, Gilbert Strang, and Andy Wathen, The potential theory of several intervals and its applications, Appl. Math. Optim., 44, 67-85, 2001.
[Keywords: equiripple optimal filters, asymptotic convergence of matrix iterations, indefinite Stokes equation in fluid dynamics, Schwarz-Christoffel mapping. Thanks go to Nick Trefethen and Mark Embree.]
J. Shen and G. Strang, Asymptotics of optimal (equiripple) filters, IEEE Trans. Signal Process., 47(4), pp. 1087-1098, 1999.
[Keywords: Kaiser's (Bell Lab) formula, Chebyshev polynomials on multi-intervals, Remez-Parks-McClellan algorithm. Thanks go to Alan Oppenheim's group.]
J. Shen, A note on wavelets and diffusions, J. Comp. Anal. Appl., 5, pp. 147-159, 2003.
J. Shen, On some quantum and analytical properties of fractional Fourier transforms, in Wavelet Analysis: Twenty Year's Developments, Ed. D.-X. Zhou, World Scientific, pp. 252-265, 2002.
J. Shen, Compactification of a set of matrices with convergent infinite products, Linear Alg. Appl., 311, pp. 177-186, 2000.
[Keywords: wavelets matrices, cascading, Rota-Strang spectral radius, König chain.]
Jianhong Shen and Gilbert Strang, On wavelet fundamental solutions to the heat equation - heatlets, J. Diff. Eqn., 161(2), 403-421, 2000.
[Keywords: fundamental solution, heat equation, scaling and translation invariance.]
J. Shen, Combinatorics for wavelets: umbral refinement equation, Studies Appl. Math., 103(2), 121-147, 1999.
T. Cai and J. Shen, Boundedness is redundant in a theorem of Daubechies, Appl. Comp. Harmon. Anal., 6(3), 400-404, 1999.
[Keywords: orthogonality and vanishing moments.]
J. Shen, Refinement differential equations and wavelets, Methods Appl. Anal., 5(3), pp. 283-316, 1998.
J. Shen and G. Strang, Asymptotics of Daubechies filters, scaling functions, and wavelets, Appl. Comp. Harmon. Anal., 5(3), 312-331, 1998.
[Keywords: pure phase, asymptotics, stationary phase, Airy function, multiscale transition.]
Thanks go to Professor Hung Cheng.
J. Shen and G. Strang, Asymptotic analysis of Daubechies polynomials, Proc. Amer. Math. Soc., 124(12), 3819-3833, 1996.
[Keywords: maxflat, lowpass, spectral factorization, vanishing moments, Szegö's asymptotics]