The Data Visualization of Large Scale AIS Trajectories Data on Hadoop

The Data Visualization of Large Scale AIS Trajectories Data on Hadoop

Table of Contents




Abstract

With the establishment of Automatic Identification System(AIS) networks, maritime vessel trajectories are becoming increasingly available. The visualization of AIS trajectories data is an effective way on large scale spatiotemporal data analysis and is critical for real-time applications ranging from military surveillance to transportation management. In this paper we use the real AIS data as experimental data and uses Hadoop as data processing and storage, presents a dynamic visualization of global marine AIS data and local sea area situation. A multi charts visualization model is presented, where the characteristics of complex ships in the port area can be analyzed.

Author Keywords

  • visualization,
  • AIS,
  • large data,
  • Hadoop

Introduction

Maritime transportation is the most important transportation nowadays. There are a vast number of ports, ships, and countless sensors in different data formats, producing huge amounts of data each minute. How to use these data reliably, accurately, and efficiently, and how to effectively discover knowledge from spatiotemporal large data are hot issues in the related area [1]. Data visualization is the visual representation of data. By designing a reasonable mapping scheme for abstract data, the data can be more easily understood, and the hidden information and rules can be displayed to users efficiently and accurately [2]. Efficient visualization scheme plays an important role in analyzing and interpreting data and improves the accessibility, comprehensibility, and usability of complex data [3]. Through the spatial and temporal statistical analysis of global AIS data on the large data platform, and visualization of data display and analysis, we can get a lot of valuable information, which can be used for surveillance and command and control in maritime traffic systems [4].

In this paper we present a visualization approach on AIS data, including a dynamic visualization and a multi-charts visualization model, Hadoop is used as data processing and storage, and experiments on real AIS data is made, which shows the effectiveness and correctness of our approach.

Related Works

The AIS data are very large location data sets, the data items on a single day can be millions, so the calculation on marine traffic data should use the big data frameworks such as Hadoop or Spark, but these traditional big data structures are ill-equipped in supporting spatial data as it deals with spatial data in the same way as non-spatial data[5]. The programs defined through the map and reduce cannot access the constructed spatial index. Nevertheless, some applications built there own platform for AIS data storage and visualization, including Marine Traffic [6], Vessel Finder [7], AISHub. While some similar applications existed in China, such as ChuanXun, Sichuan. These are AIS data processing platforms, with the help of AIS big data, provide people with ship location information visualization or data service such as fleet tracking, historical data reproduction, navigation forecasting, port statistics, etc. Trajectory visualization of AIS Spatio-temporal data in these related works mainly uses expanded maps, arrows, and a series of maps at different times to show the changing process of trajectory, so that the observer can form a sense of dynamic change.

There are also visualization toolsets for large data sets, such as E-Chart [8] and Table [9]. E-Chart is a visual processing tool that has JavaScript libraries based on data documents. Using programming languages such as HTML, scalable vector graphic, and cascading style sheets to make the data more vivid. It can integrate powerful visual components and data-driven approaches with the operation of the document object model. Tableau is a map-based visualization tool that can integrate and generate various styles of gorgeous map backgrounds, add map layers and contexts, and generate maps matching user data. The visual interface designed by tableau software can easily interact with data. In this paper, we use the Alibaba cloud platform to analyze the large-scale ship AIS data and a collection of visualization tools such as Echart and Tableau, which provides a new idea for the analysis and research of AIS data visualization.

Conclusion

With the rapid development of related research, AIS data analysis provides a decision-making basis for various military, economy, and other applications. At present, combining human visual perception with computer processing ability, big data visualization is an important approach to study this problem. In this paper we use the real AIS data as experimental data and uses Hadoop as data processing and storage, presents a dynamic visualization of global marine AIS data and local sea area situation. A multi-graph visualization model is presented, where the characteristics of complex ships in the port area can be analyzed. Future works should be focused on 1.More sophisticated data pre-processing approaches in data cleaning. 2.Detailed analysis and interpretation of visualization results. More visualizations models related to real applications, such as outline detection, clustering.etc.

About KSRA

The Kavian Scientific Research Association (KSRA) is a non-profit research organization to provide research / educational services in December 2013. The members of the community had formed a virtual group on the Viber social network. The core of the Kavian Scientific Association was formed with these members as founders. These individuals, led by Professor Siavosh Kaviani, decided to launch a scientific / research association with an emphasis on education.

KSRA research association, as a non-profit research firm, is committed to providing research services in the field of knowledge. The main beneficiaries of this association are public or private knowledge-based companies, students, researchers, researchers, professors, universities, and industrial and semi-industrial centers around the world.

Our main services Based on Education for all Spectrum people in the world. We want to make an integration between researches and educations. We believe education is the main right of Human beings. So our services should be concentrated on inclusive education.

The KSRA team partners with local under-served communities around the world to improve the access to and quality of knowledge based on education, amplify and augment learning programs where they exist, and create new opportunities for e-learning where traditional education systems are lacking or non-existent.

FULL Paper PDF file:

The Data Visualization of Large Scale AIS Trajectories Data on Hadoop

Bibliography

author

B. Lei

Year

2020

Title

The Data Visualization of Large Scale AIS Trajectories Data on Hadoop

Publish in

2020 6th International Conference on Control, Automation, and Robotics (ICCAR), Singapore, Singapore, 2020, pp. 758-761,

Doi

10.1109/ICCAR49639.2020.9108055

PDF reference and original file: Click here

+ posts

Somayeh Nosrati was born in 1982 in Tehran. She holds a Master's degree in artificial intelligence from Khatam University of Tehran.

Website | + posts

Professor Siavosh Kaviani was born in 1961 in Tehran. He had a professorship. He holds a Ph.D. in Software Engineering from the QL University of Software Development Methodology and an honorary Ph.D. from the University of Chelsea.

Website | + posts

Nasim Gazerani was born in 1983 in Arak. She holds a Master's degree in Software Engineering from UM University of Malaysia.