Aerial Robotic Work System

Data processing can be done live in flight or post-flight.

‍

The YACOB drone is equipped with a set of Artificial Intelligence functionalities. These can be seen as visual data which the drone itself interprets and on which it will adjust its flight behavior.

‍

A.I. – Artificial Intelligence on board processing – Track, trace and follow people, cars, containers, ships, and boats. The onboard processing unit allows the UAV to interpret and analyse the visual data acquired using A.I. This analysis – i.e. track and trace people and vehicle recognition – is done in real-time due to the powerful onboard GPU. Thanks to the RGB and I.R. image overlay with the two cameras, the A.I. can also be trained to operate in night conditions.

Within the daily operations, the ARWS platform is continuously working to generate data about the various installations and the use of the UAVs in the field. On a permanent basis, the following modules will be active:

1. The daily operations
2. The maintenance inventory
3. Reporting of fleet management

The maintenance inventory

The UAV fleet maintenance management consists of a list of planned maintenance orders, the urgent maintenance orders included therein (from a critical need for intervention) and the status of each installation regarding the maintenance situation and history. This module is fed continuously from the operations in the field. On the one hand, these are jobs that are assigned to the maintenance service; on the other hand, the maintenance work is carried out and reported after checking and/or repairing the equipment.

‍

Reporting of fleet management

It is very important to be able to follow up live on the operational situation at any given time and ensure that the ARWS platform thoroughly reports its evolution and history. To this end, the reporting of all relevant parameters is crucial.

Reporting occurs at the level of online histories, data exports and advanced searches to get a clear overview of the situation. Regarding the history of the fleet and the quality of the operations, the ARWS platform is perfectly capable of providing extensive reporting.

‍

The ARWS platform is designed with robust integration capabilities to accommodate various third-party systems, enhancing its versatility and functionality. The ARWS platform ensures a comprehensive and adaptable solution for diverse operational needs by allowing seamless integration with external systems and technologies.

‍

Data Integration

‍

1. Pre-Flight Integration:

• Data Sources: The ARWS integrates various data sources, including geo-awareness, meteorological data, GIS, AIS, and third-party sources. These data points are crucial for flight planning and situational awareness, allowing the platform to calculate the least risky mission routes.
• AIS Integration: The ARWS platform incorporates AIS data for ship specifications and positions, which is essential for safe flight operations in dynamic environments like ports. This integration helps in flight planning and risk analysis by providing up-to-date information on potential obstacles.
• Situational Awareness: Data from third-party providers, such as aeronautical data (AIP/NOTAM), R.F. coverage data, and crowd density data, is used by the Situational Awareness Service to evaluate and optimise mission plans.

2. In-Flight Integration:

• Real-Time Updates: The ARWS platform continually updates flight status and UAV telemetry data to the UTM platform via the UOM-UTM Gateway during flight operations. This ensures the flight status is current and visible on the UTM platform’s Flightview.
• Emergency Response: In emergencies, the ARWS can receive and execute instructions from the UTM platform, such as landing commands, which are transmitted through the UOM-UTM Gateway.

3. Post-Flight Integration:

• Data Visualisation: The data collected during the flight, including telemetry and traffic information, is processed and visualised to provide a comprehensive overview of the operation, aiding decision-making and future planning.

Integrating third-party data and services into the ARWS platform significantly enhances its capability to manage complex flight operations, ensuring safety, compliance, and efficiency. By leveraging a wide range of data sources and maintaining secure communication channels, DroneMatrix’s ARWS platform provides a robust solution for aerial robotic operations.

‍

Payload Integration

The ARWS platform supports the integration of various payloads, enabling users to customise their drones for specific missions. This includes but is not limited to:

• Cameras: High-resolution cameras for surveillance, inspection, and mapping.
• Sensors: Specialised sensors such as thermal, infrared, and multispectral sensors for diverse applications.
• Delivery Systems: Payload mechanisms for transporting and releasing items that are useful in logistics and medical supply delivery.

The integration process involves standardised interfaces and protocols to ensure compatibility and efficient communication between the drone’s onboard systems and the ARWS platform. This allows for real-time data acquisition and processing, enhancing situational awareness and operational effectiveness.

‍

Video Management Systems (VMS) Integration

The ARWS platform also integrates seamlessly with Video Management Systems (VMS) like Milestone, enhancing its surveillance and monitoring capabilities. Key aspects of this integration include:

• Real-time Video Streaming: The ARWS can stream live video feeds from drones directly into the VMS, allowing for immediate analysis and response.
• PTZ (Pan-Tilt-Zoom) Camera Control: Integration with PTZ cameras enables automatic tracking and manual control, ensuring that critical areas are monitored effectively.
• A.I. and Analytics: Leveraging the analytical capabilities of VMS, the ARWS can enhance video feeds with AI-driven analytics for object detection, motion tracking, and anomaly detection.

The ARWS platform’s ability to integrate with third-party payloads and Video Management Systems like Milestone exemplifies its flexibility and robustness. These integrations expand the platform’s capabilities, allowing it to meet a wide range of operational requirements and providing users with a versatile, powerful tool for managing and executing drone missions efficiently.

‍

By embracing these integrations, the ARWS platform ensures that it remains at the forefront of drone technology, offering users a cutting-edge solution that is both adaptable and scalable.

The system is structured so that all telemetry data is written to a database. This data is made accessible to users in various ways.

The most important page in this system is the “Flight History” page, which is the logbook of all flights performed. In addition, the telemetry data from both the drone and the docking station is made available independently to check the system’s operation outside the flights.

‍

Flight History

The “Flight History” page serves as the logbook of all flights performed with the system. The page lists all flights and allows filtering to select a smaller set (e.g., a certain period or a specific drone). The list can also be exported via this page to an Excel or CSV file for reporting. From this list, a specific flight can be chosen to view in more detail. The detailed view of the selected flight opens in a new tab.

‍

The “Data” tab shows all data collected during the flight and previews all files with a supported format. There are also buttons to download each file individually or all files simultaneously. Finally, exporting the recorded telemetry data in different formats for further post-processing is possible.