CE-Net: A Coordinate Embedding Network for Mismatching Removal
Mismatching removal is at the core yet still a challenging problem in the photogrammetry and computer vision field. In this paper, we propose a coordinate embedding network (named CE-Net). We consider the mismatching problem as a graph node classification problem, and generate node descriptors by em...
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
IEEE
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/e241b86d2f1c4e0d8ecbfd0c4ff4b61b |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:e241b86d2f1c4e0d8ecbfd0c4ff4b61b |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:e241b86d2f1c4e0d8ecbfd0c4ff4b61b2021-11-18T00:05:52ZCE-Net: A Coordinate Embedding Network for Mismatching Removal2169-353610.1109/ACCESS.2021.3123942https://doaj.org/article/e241b86d2f1c4e0d8ecbfd0c4ff4b61b2021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9592787/https://doaj.org/toc/2169-3536Mismatching removal is at the core yet still a challenging problem in the photogrammetry and computer vision field. In this paper, we propose a coordinate embedding network (named CE-Net). We consider the mismatching problem as a graph node classification problem, and generate node descriptors by embedding point coordinates and aggregating geometric information from neighboring nodes based on self-attention and cross-attention mechanism. Finally, a binary classifier is used to separate node descriptors into two classes, namely matching inliers and outliers. Benefiting from the attention mechanism, firstly the node descriptors can get geometric information from “good neighbors” (i.e., matching inliers) and keep away from “bad neighbors” (i.e., matching outliers), improving the exactness of the descriptors; secondly the node descriptors can contain the information from both intra-graph and inter-graph, improving their distinctiveness. Experiments in testing datasets show that our proposed CE-Net achieves the state-of-the-art performance with a precision of 0.972, an outlier recall of 0.984, and an inlier recall of 0.963. Furthermore, CE-Net also outperforms the compared methods in real mismatching removal tasks in terms of positional accuracy, dispersion, and number of remaining point pairs, showing great potentials in practical applications. Our codes and data are available on <uri>https://github.com/csyhy1986</uri>.Shiyu ChenJiqiang NiuCailong DengYong ZhangFeiyan ChenFeng XuIEEEarticleCoordinate embeddingnode classificationattention mechanisminter-graphintra-graphbinary classifierElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENIEEE Access, Vol 9, Pp 147634-147648 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
Coordinate embedding node classification attention mechanism inter-graph intra-graph binary classifier Electrical engineering. Electronics. Nuclear engineering TK1-9971 |
| spellingShingle |
Coordinate embedding node classification attention mechanism inter-graph intra-graph binary classifier Electrical engineering. Electronics. Nuclear engineering TK1-9971 Shiyu Chen Jiqiang Niu Cailong Deng Yong Zhang Feiyan Chen Feng Xu CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| description |
Mismatching removal is at the core yet still a challenging problem in the photogrammetry and computer vision field. In this paper, we propose a coordinate embedding network (named CE-Net). We consider the mismatching problem as a graph node classification problem, and generate node descriptors by embedding point coordinates and aggregating geometric information from neighboring nodes based on self-attention and cross-attention mechanism. Finally, a binary classifier is used to separate node descriptors into two classes, namely matching inliers and outliers. Benefiting from the attention mechanism, firstly the node descriptors can get geometric information from “good neighbors” (i.e., matching inliers) and keep away from “bad neighbors” (i.e., matching outliers), improving the exactness of the descriptors; secondly the node descriptors can contain the information from both intra-graph and inter-graph, improving their distinctiveness. Experiments in testing datasets show that our proposed CE-Net achieves the state-of-the-art performance with a precision of 0.972, an outlier recall of 0.984, and an inlier recall of 0.963. Furthermore, CE-Net also outperforms the compared methods in real mismatching removal tasks in terms of positional accuracy, dispersion, and number of remaining point pairs, showing great potentials in practical applications. Our codes and data are available on <uri>https://github.com/csyhy1986</uri>. |
| format |
article |
| author |
Shiyu Chen Jiqiang Niu Cailong Deng Yong Zhang Feiyan Chen Feng Xu |
| author_facet |
Shiyu Chen Jiqiang Niu Cailong Deng Yong Zhang Feiyan Chen Feng Xu |
| author_sort |
Shiyu Chen |
| title |
CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| title_short |
CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| title_full |
CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| title_fullStr |
CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| title_full_unstemmed |
CE-Net: A Coordinate Embedding Network for Mismatching Removal |
| title_sort |
ce-net: a coordinate embedding network for mismatching removal |
| publisher |
IEEE |
| publishDate |
2021 |
| url |
https://doaj.org/article/e241b86d2f1c4e0d8ecbfd0c4ff4b61b |
| work_keys_str_mv |
AT shiyuchen cenetacoordinateembeddingnetworkformismatchingremoval AT jiqiangniu cenetacoordinateembeddingnetworkformismatchingremoval AT cailongdeng cenetacoordinateembeddingnetworkformismatchingremoval AT yongzhang cenetacoordinateembeddingnetworkformismatchingremoval AT feiyanchen cenetacoordinateembeddingnetworkformismatchingremoval AT fengxu cenetacoordinateembeddingnetworkformismatchingremoval |
| _version_ |
1718425256255815680 |