3D Shape Retrieval

I am currently a post-doc research associate at Cardiff University performing research into 3D shape retrieval, specifically exploring methods for non-rigid and partial shape retrieval.

Publications

Shape Retrieval of Non-Rigid 3D Human Models

David Pickup, Xianfang Sun, Paul L. Rosin, Ralph R. Martin, Cheng, Z, Lian, Z, Aono, M, Ben Hamza, A, Bronstein, A, Bronstein, M, Bu, S, Castellani, U, Cheng, S, Garro, V, Giachetti, A, Godil, A, Isaia, L, Han, J, Johan, H, Lai, L, Li, B, Li, C, Li, H, Litman, R, Liu, X, Liu, Z, Lu, Y, Sun, L, Tam, G, Tatsuma, A and Ye, J, "Shape Retrieval of Non-Rigid 3D Human Models", International Journal of Computer Vision 2016.

Abstract

3D models of humans are commonly used within computer graphics and vision, and so the ability to distinguish between body shapes is an important shape retrieval problem. We extend our recent paper which provided a benchmark for testing non-rigid 3D shape retrieval algorithms on 3D human models. This benchmark provided a far stricter challenge than previous shape benchmarks. We have added 145 new models for use as a separate training set, in order to standardise the training data used and provide a fairer comparison. We have also included experiments with the FAUST dataset of human scans. All participants of the previous benchmark study have taken part in the new tests reported here, many providing updated results using the new data. In addition, further participants have also taken part, and we provide extra analysis of the retrieval results. A total of 25 different shape retrieval methods are compared.

Skeleton-Based Canonical Forms for Non-Rigid 3D Shape Retrieval

David Pickup, Xianfang Sun, Paul L. Rosin, Ralph R. Martin, "Skeleton-Based Canonical Forms for Non-Rigid 3D Shape Retrieval", Computational Visual Media, 2016.

PDF CODE

Abstract

The retrieval of non-rigid 3D shapes is an important task. A common technique is to simplify this problem to a rigid shape retrieval task by producing a bending-invariant canonical form for each shape in the dataset to be searched. It is common for these techniques to attempt to “unbend” a shape by applying multidimensional scaling (MDS) to the distances between points on the mesh, but this leads to unwanted local shape distortions. We instead perform the unbending on the skeleton of the mesh, and use this to drive the deformation of the mesh itself. This leads to computational speed-up, and reduced distortion of local shape detail. We compare our method against other canonical forms: our experiments show that our method achieves state-of-the-art retrieval accuracy in a recent canonical forms benchmark, and only a small drop in retrieval accuracy over the state-of-the-art in a second recent benchmark, while being significantly faster.

SHREC'16 Track: Partial Shape Queries for 3D Object Retrieval

I. Pratikakis, M.A. Savelonas, F. Arnaoutoglou, G. Ioannakis, A. Koutsoudis, T. Theoharis, M.-T. Tran, V.-T. Nguyen,V.-K. Pham, H.-D. Nguyen, H.-A. Le, B.-H. Tran, Q.H. To, M.-B. Truong, T.V. Phan, M.-D. Nguyen, T.-A. Than, K.-N.C. Mac, M.N. Do, A-D. Duong, T. Furuya, R. Ohbuchi, M. Aono, S. Tashiro, D. Pickup, X. Sun, P.L. Rosin, R.R. Martin, "SHREC’16 Track: Partial Shape Queries for 3D Object Retrieval", Eurographics Workshop on 3D Object Retrieval, Lisbon, Portugal, May 2016.

Abstract

Despite numerous recent efforts, 3D object retrieval based on partial shape queries remains a challenging problem, far from being solved. The problem can be defined as: given a partial view of a shape as query, retrieve all partially similar 3D models from a repository. The objective of this track is to evaluate the performance of partial 3D object retrieval methods, for partial shape queries of various scan qualities and degrees of partiality. The retrieval problem is often found in cultural heritage applications, for which partial scans of objects query a dataset of geometrically distinct classes.

SHREC'15 Track: Canonical Forms for Non-Rigid 3D Shape Retrieval

David Pickup, Xianfang Sun, Paul L. Rosin, Ralph R. Martin, Zhiquan Cheng, Sipin Nie, Longcun Jin, “SHREC'15 Track: Canonical Forms for Non-Rigid 3D Shape Retrieval”, Eurographics Workshop on 3D Object Retrieval, Zurich, Switzerland, May 2015.

Abstract

We present a new benchmark for testing algorithms that create canonical forms for use in non-rigid 3D shape retrieval. We have combined two existing datasets to create a varied collection of models for testing. Canonical forms attempt to factor out a shape's pose, giving a pose-neutral shape. This opens up the possibility of using methods originally designed for rigid retrieval for the task of non-rigid shape retrieval. We demonstrate the benchmark by using it to compare the performance of nine canonical form methods, using three different retrieval algorithms.

SHREC'15 Track: Non-Rigid 3D Shape Retrieval

Lian, Z.; Zhang, J.; Choi, S.; ElNaghy, H.; El-Sana, J.; Furuya, T.; Giachetti, A.; Guler, R.A.; Lai, L.; Li, C.; Li, H.; Limberger, F.A.; Martin, R.R.; Nakanishi, R.U.; Neto, A.P.; Nonato, L.G.; Ohbuchi, R.; Pevzner, K.; Pickup, D.; Rosin, P.L.; Sharf, A.; Sun, L.; Sun, X.; Tari, S.; Unal, G.; Wilson, R.C., “SHREC'15 Track: Non-Rigid 3D Shape Retrieval”, Eurographics Workshop on 3D Object Retrieval, Zurich, Switzerland, May 2015.

Abstract

Non-rigid 3D shape retrieval has become a research hotpot in communities of computer graphics, computer vision, pattern recognition, etc. In this paper, we present the results of the SHREC’15 Track: Non-rigid 3D Shape Retrieval. The aim of this track is to provide a fair and effective platform to evaluate and compare the performance of current non-rigid 3D shape retrieval methods developed by different research groups around the world. The database utilized in this track consists of 1200 3D watertight triangle meshes which are equally classified into 50 categories. All models in the same category are generated from an original 3D mesh by implementing various pose transformations. The retrieval performance of a method is evaluated using 6 commonly-used measures (i.e., PR-plot, NN, FT, ST, E-measure and DCG.). Totally, there are 37 submissions and 11 groups taking part in this track. Evaluation results and comparison analyses described in this paper not only show the bright future in researches of non-rigid 3D shape retrieval but also point out several promising research directions in this topic.

Euclidean-distance-based canonical forms for non-rigid 3D shape retrieval

Pickup, D.; Sun, X.; Rosin, P.L.; Martin, R.R. “Euclidean-distance-based canonical forms for non-rigid 3D shape retrieval”, Pattern Recognition 2015.

PDF CODE

Abstract

Retrieval of 3D shapes is a challenging problem, especially for non-rigid shapes. One approach giving favourable results uses multidimensional scaling (MDS) to compute a canonical form for each mesh, after which rigid shape matching can be applied. However, a drawback of this method is that it requires geodesic distances to be computed between all pairs of mesh vertices. Due to the super-quadratic computational complexity, canonical forms can only be computed for low-resolution meshes. We suggest a linear time complexity method for computing a canonical form, using Euclidean distances between pairs of a small subset of vertices. This approach has comparable retrieval accuracy but lower time complexity than using global geodesic distances, allowing it to be used on higher resolution meshes, or for more meshes to be considered within a time budget.

SHREC’14 Track: Shape Retrieval of Non-Rigid 3D Human Models

Pickup, D.; Sun, X.; Rosin, P.L.; Martin, R.R.; Cheng, Z.; Lian, Z.; Aono, M.; Ben Hamza, A.; Bronstein, A.; Bronstein, M.; Bu, S.; Castellani, U.; Cheng, S.; Garro, V.; Giachetti, A.; Godil, A.; Han, J.; Johan, H.; Lai, L.; Li, B.; Li, C.; Li, H.; Litman, R.; Liu, Z.; Lu, Y.; Tatsuma, A.; Ye, J., “SHREC’14 Track: Shape Retrieval of Non-Rigid 3D Human Models”, Eurographics Workshop on 3D Object Retrieval, Strasbourg, France, April 2013.

Abstract

We have created a new benchmarking dataset for testing non-rigid 3D shape retrieval algorithms, one that is much more challenging than existing datasets. Our dataset features exclusively human models, in a variety of body shapes and poses. 3D models of humans are commonly used within computer graphics and vision, and so the ability to distinguish between body shapes is an important shape retrieval problem. In this track nine groups have submitted the results of a total of 22 different methods which have been tested on our new dataset.

Track website: www.cs.cf.ac.uk/shaperetrieval/shrec14