Seems astonishing, right? 308-312. WSI Airport Analytics delivers the above capabilities in an easy-to-use, powerful upgrade to WSI’s Fusion Surface Movement Package. For instance, the use of Internet of Things (IoT) data transmitted by airplane gear, … Implementation is available on our git repository as open source software [11]. This process can be automated by adding video processing capabilities into the in-built CCTV system. Some key use cases of video based security and surveillance are as follows: Figure 7: Overview of Security and Surveillance System. traffic monitoring, security, and surveillance, … For example, the video stream captured from a camera aimed at an infant could be processed using an Eulerian video magnification and an optical flow algorithm to detect the infant’s respiratory rate. According to ACI, the world's busiest airports have around 5 movements per minute during peak hours. The introduction of analytics into the aviation industry will result in cost reductions in case of baggage loss. When you are in favor of a particular airline, it becomes easier for them to know how the customer thinks and behaves. [1] V. Ganesan, Y. Ji, M. Patel "Video meets the Internet of Things". The marketing department uses historical weather information, and begin a plan to target stranded airport passengers. He/she can be assigned a unique identifier within the system with an authorization level to access different areas of the premise. There are several object tracking algorithms and methods that can be used to track a detected object. If you are going for finest contents like I do, just Technology developments have prompted machines to take over routines tasks, making the lives of people much easier. Today’s flyers are happy with the fact that their airlines know where they are, who their co-passengers are, and what climatic conditions will they be met with on arrival at their destination. Abdelghany et al. of Fourth Alvey Vision Conference, pp.147-151. International journal of computer vision, 60(2), 91-110. The dashboard can be configured in any manner where one can display the plane’s state with respect to the timestamp or frame ID. Started as a hobby, the site now has become so important in tracking thousands of flights around the world many airports and airlines use FlightAware to help process and analyze their own data they are providing to the FAA. The approach used in this case study is generic and can be used in any software project. But even though the cameras can see the world, they do not have the ability to understand the world as humans do. We also discussed three main use cases of video processing, i.e. Video data is grabbed from the CCTV cameras. This white paper will discuss the concept and technology behind video processing, a reference architecture to build a system that can extract high-level information from camera feeds, and some use cases of real-world applications. In fact, it has embraced big data in more ways than one. If this data is inspected and analyzed, it goes a long way in improving the safety of the flight. [17] Koolen, Ninah, Olivier Decroupet, Anneleen Dereymaeker, Katrien Jansen, Jan Vervisch, Object recognition is widely used for face recognition, number plate recognition, and handwriting recognition. Industry analysts say that the airline industry has always been adept at data collection since the beginning but this data has never been put to good use. So, AI technologies are useful for various aspects of airline operation management. For example, in such scenarios the dimensional change that takes place in each and every pedestrian’s/cyclist’s bounding box in the video stream can be used to estimate their direction of movement. The airport also shares these insights with the police and security teams to help them improve the service and security in the long term. Government Administration. © Promptcloud 2009-2020 / All rights reserved. Analytics and text mining techniques help the industry to understand … Available: [3] Tensorflow.org,'About Tensorflow',[Online].Available: [4] ImageNet.org, 'Image Net',[Online].Available: [5] A. Krizhevsky, I. Sutskever, G.E Hinton "ImageNet Classification with Deep Convolutional Neural Networks" in Neural Information Processing Systems Conference 2012. Then the extracted data is sent to WSO2 Stream Processor to be processed. The video processing engine then processes the video and the extracted data is sent to WSO2 Stream Processor to process. With some estimated 2-3% of flights cancelled daily, 500 planes don’t take off, … In Paris in terminal one a passenger is feeling ill. Learn more about how IT operational analytics works by reading some case studies below: Case … In peak hours, the rate spikes to one movement per minute. For example, the video stream captured from a CCTV camera can be used to track the centroid of the intended object. In this paper, we will focus only on the main approach, i.e. This topic is currently very popular in the research community. Learn which data sources provide the most critical information, explore navigation paths and airport … There are several image processing libraries and here we'll consider two of them: OpenCV is an open source computer vision and machine learning library that was specially developed for this kind of image processing and video processing tasks [2]. Thanks to big data, of late, airlines are able to utilize big data techniques in order to strengthen the customer value and relationship and thus increase customer loyalty. This approach has shot up United Airlines’ annual revenue by 15%. [7] WSO2.com,'WSO2 Stream Processor'.[Online]. Then, using Siddhi queries, we filtered the data and identified the plane’s arrival time, current state of the plane, whether it is approaching to the terminal or docked in the terminal. A simple booking of one airline ticket gives enough information about you that can be used in ways that are useful. Vos. monitoring system," 2010 7th International Symposium on Communication Systems, The Oracle Stream Analytics platform targets a wealth of industries and functional areas. It should be noted that WSO2's video analytics platform’s capabilities are not limited to the above-mentioned use cases and can also equally be applied virtually in any use case where video processing is required. Prev - Tips on properly extracting web data from even the most challenging sites by using best practices of web scraping, Next - Interesting Ways in Which Marriott Leverages Social Data – PromptCloud, Why Web Scraping should be at The Core of Your Business Strategy, Web Scraping IMDB for The Best Movies and Shows, Global Data: Key to Access COVID-19 Impact. Moreover, the same model can be used to monitor speeding vehicles. One such method of sourcing data is via video analytics. This field is for validation purposes and should be left unchanged. Splunk Use Cases • IT operations • Business analytics • Internet of Things • Security Challenges • Needed to increase airport capacity without any additional terminal space, infrastructure or runways Business Impact • 95 percent of passengers through security in five minutes or less Fastest airport … We list down three concrete use cases of transport monitoring conducted via video processing below. Busy airports offer prime use cases for sensors. WSO2 Stream Processor has the capability of presenting the processed data through analytical dashboard in a very attractive manner. To further understand the reference architecture, let’s look at a concrete video processing example. The mobility and device management layer configures all the devices that are involved throughout the process and it can be used to send data and display on mobile devices. We’ve provided the installation instructions and the required resources on the same repository. As a rule, the damages are repaid by the industry, but when using real-time baggage tracking, … In video processing, a video will be read frame by frame, and for each frame, image processing will be applied to extract the features from that frame. There is no better way to achieve this than to shower you, the customer, with customized offers. Every airline, large or small has data stored with it. The capabilities of … The following Siddhi query is a one simple query we used to generate the graph shown in Figure 5. If you are looking for such datasets for analysis to provide better customer service, you can contact the team at PromptCloud. Marketing, crew and flight operations, and aerial cargo are some of them. To process the extracted data the size of the detected bounding box, frame ID, and timestamp were sent to WSO2 Stream Processor. They got bookings of $1 million worth per week, just from these email communications. We also discussed three main use cases of video processing, i.e. Cascading is an ensemble learning technique that concatenates several classifiers in a multi stage manner [9]. The challenge lies in translating data into actionable insight. The representatives at Southwest Airlines can analyze social media data to get to know their customers even better. Available. The number of vehicles detected from each frame is communicated externally as the output. "Automated Respiration Detection from Neonatal Video Data." IoT Analytics’ recently published the Industrial AI Market Report 2020-2025.As part of the research, the analyst team identified a total of 33 different use cases that employ Artificial Intelligence tools and … 770-774. Back Office ( Finance, Human Resources, Procurement) Data analytics helps agencies identify: least cost vendor with highest … We often forget that we have a ubiquitous sensor that covers most of the world: the camera. Vladimir Matic, Bart Vanrumste, Gunnar Naulaers, Sabine Van Huffel, and Maarten De This website uses cookies so that we can provide you with the best user experience. Then the finalized data gets stored in a database for future needs and the real-time data are presented through the Plane Detection Dashboard. Big Data case study: 5 relevant examples from the airline industry. Big data solutions help the airlines to understand their customers individually, their preferences, their behavioral patterns, and also predict the requests that might come up. Every person traveling on a flight has a nightmare of losing his/her baggage. Figure 5 shows a graph that displays the real-time state of a plane. The only way to [increase our capacity] is to apply technology on customer-centric processes and use our data and a platform like Splunk to give us the real-time insights to drive efficiency across the airport. Figure 2: Mapped Reference Architecture to WSO2 Products. It took nearly a week to train a considerably accurate cascade by using a machine that has a 16 core Intel Xeon 2.30GHz processor and 64GB of RAM. But most of it is in an unorganized manner. Such scenarios can be broken down into three categories; object detection, object recognition, and object tracking. This can be mentioned as the foundation of computer vision because for all other cases, object detection output will be used as an input. Wearable Technology & IoT: Turkish Airlines is also planning to use big data and the Internet of Things (IoT) technologies operating the service at Istanbul’s new airport in 2018. The case study includes identification of actors, use cases and scenarios including activity diagram. A couple of decades earlier, an airplane was just one of the modes of transport. This is particularly the case in the airline industry, where on numerous occasions a big data case study has … In this Use Case case study, I am going to present a case study of airport check-in system. Pedestrians/cyclist monitoring is another example of video-based transport monitoring. Multiple image processing algorithms have been implemented in OpenCV that can be directly used with Java, C++ and Python [2]. The industry is using big data to bring in a change in the customer experience department. ... hours for capital resources. The grabbed data are forwarded to the video processing layer to conduct the processing. And the use cases of data science in the airline industry abound. If Stream Processor detects a speeding driver it will directly report it to respective person who's monitoring this using dashboard server capabilities of WSO2 Stream Processor which is known as analytics dashboard. A video processing system that has the capability of surveillance can be easily implemented using the above reference architecture. [Online].Available: [2] OpenCV.org,'About OpenCV',2016.[Online]. If the centroid is within the specific area then that particular object is identified as an intruder [19]. The second step of the process initializes the cascade and then processes the video feed to detect the planes. In the real world, most of the scenarios can be understood by determining a particular object’s identity and by monitoring the movements of that object. Tensorflow, on the other hand, is an open source machine learning library developed by Google that’s capable of doing object detection with a high accuracy [3]. and also discussed how these can be applied in real-world use cases. In ICPRAM (2), pp. Big data is reshaping business. Available, [12] Bovik, A.C. (2010), Handbook of Image and Video Processing, Elsevier Science, Pp.1282-1285. When you have a special offer presented according to your preferences and priorities, the natural tendency is to go for it. There are many approaches for video processing. Overall progress also gets reported to the end user and will be logged in a separate database. According to the processed data, the traffic control system will control the devices that are connected to it. Even though we only used OpenCV in this use case, we can repeat the same by using Tensorflow as well. This case … A client of theirs chalked out a marketing plan around some abandoned carts and personalized emails were sent to the customers. monitoring-of-pedestrian-movements-at-signalized-inte. It uses neural network-based approaches to do the learning parts and has the ability to retrain on top of pre-trained models obtained from image databases like ImageNet [4] and AlexNet [5]. Identity and access management secures communication throughout the whole process and manages the system’s security and authentication requirements. The following are some use cases: Telecommunications: Ability to perform real-time call detail (CDR) record … Special Incidence Detection is another example use case of video-based transport monitoring. If considered a person, it is very challenging due to the perceptual details and interferences, such as poses, lighting conditions, and illuminations. Video processing can take surveillance and other monitoring tasks to a whole new level, reducing time, money, and human effort; in turn, this makes industries more secure, reliable, and consistent. [15] Jeong Lee (2014), CCTV-Aided Accident Detection System on Four Lane Highway with Nowadays, since the cost of data storage and processing has come down, in spite of tons of data being collected, it is getting easier to process and channelize it properly. Distinctive image features from scale-invariant keypoints. This can be applied to the computer vision as well. Such a system is useful not only for surveillance purposes, but for security purposes as well. Figure 1: Reference Architecture for Video Analytics. In those scenarios, the implementation shown in Figure 6 can be used with the relevant model to detect objects. 5.1 Traffic Controlling System/Traffic Violation Monitoring System, http://www.mckinsey.com/industries/high-tech/our-insights/video-meets-the-internet-of-things, https://wso2.com/products/identity-server/, https://github.com/wso2-incubator/video-image-preprocessing-wso2.git, http://ocean.kisti.re.kr/downfile/volume/kics/GCSHCI/2014/, https://arizona.pure.elsevier.com/en/publications/video-based- Then for each frame, FrameID, Time,PlaneDetected counter and the PlaneState is sent to WSO2 Stream Processor as a HTTP POST request. 23-29. The details are analyzed in a fraction of a second and custom made offers are presented to you. The main approach is to consider video frames as images and process those images using image processing techniques where we can see video processing as a collection of image processing tasks. So we used this to present the processed data to user. Required fields are marked *. Video processing can be recognized as a combination of three main tasks: The human eye can differentiate a bird and a plane at a glance; likewise, machines can be trained to do that using object detection models, such as Tensorflow models and OpenCV cascades. pay a quick visit this web site all the time for the reason that it provides Heathrow Airport began a digitisation project two years ago and used the Microsoft Azure cloud and Microsoft Power BI to empower staff to use analytics in their day-to-day jobs. Figure 4: Deployment diagram of the plane detection application, Figure 5: State of the plane with respect to the frame ID. Video processing can be described as an initiative for solving this problem by bridging the gaps. For this solution, two of the above mentioned tasks (object detection and the object tracking) have been used. pedestrian movements at signalized intersections, [Online]. Southwest Airlines has tied up with a software company called Aspect to generate a unique set of customer contacts and workforce optimization solutions. Unauthorized access and abnormal behaviors can also be monitored using such a system. treating video frames as images. Figure 6 elaborates how video processing can be deployed in a traffic control system. Airport Analytics (AA+) Modules. NASA along with machine learning algorithms has an automated system that analyses huge volumes of data and finds out inconsistencies leading to any accidents. [18] K. S. Tan, R. Saatchi, H. Elphick and D. Burke, "Real-time vision based respiration A plane detection scenario was implemented as a sample solution for video processing. This is normally done by communicating with the pilot, and tracking movement via CCTV cameras that cover almost every inch of the airport. There’s a variety of marketing use cases that can be applied in the airline industry. [19] H. Chen, D. Chen and X. Wang, "Intrusion detection of specific area based on video," As discussed in the above case study, this can be used to monitor public transport services like bus services, train services, and cab services as well. The team proposed to … [14] Lowe, D. G. (2004). Machine Learning, 41(3), 315-343. Some pieces of information that the airlines already know about you are: –           Departure time and Arrival time, –           The number of people you’re traveling with, –           Number of points earned in the Credit card, –           Shopping, in the flight and at the airport, –           Car rentals and cab transports. Training a cascade classifier (which is required to detect objects) was one of the main tasks of this video processing solution because the total accuracy of the system is directly dependent on the plane detection accuracy. One model has the ability to detect the objects from multiple classes and multiple objects in the frame. The ability to identify use cases for your data is a key way to get real answers to problems and create more efficient workflows. And while data is often available, the sheer volume and frequency can be overwhelming for the respective enterprise to form a complete picture. At each entry point of the areas within the premise, the access to him/her can be granted based on the authorization level. Southwest Airlines has a partnership with NASA for many years, to be warned of any safety concerns and maintain air safety. Live video feeds that are grabbed from the available traffic cameras can be used as the input to the system. Figure 1 depicts a reference architecture that shows how to built such a system. By Anusha Jayasundara, Software Engineer, WSO2 & All these tasks are performed as mathematical functions as doing this manually without using a specific library is a very painful task. After a plane lands, the location of the plane should be monitored in order to control ground traffic in the airport. Video processing is a technique that can be considered as a milestone of achieving intelligence in the computer vision field. Here are some of the real-time examples: Airlines are constantly competing with one another to see a smile on their customer’s faces. In tracking, object detection is used to construct an initial input and the detected object will be tracked throughout the video. Under traffic monitoring, video processing can be used to detect vehicles, control traffic by monitoring vehicle density, and even used to track a vehicle by reading the license plate of a vehicle. Are presented through the plane activity data set with around 4000 images of planes was to. Check-In system filters have to be warned of any safety concerns and maintain air.... Open source software [ 11 ] Github.com, OpenCV_PlaneDetection, [ Online ] image! Hospitals is another application of surveillance [ 18 ] his/her face shower you the... Video based security and authentication purposes available faces, and handwriting recognition ( figure 2 ) a... The object tracking algorithms and methods that can be applied to the user interface and dashboard layer outputs final! Will need to do much more than image processing, Elsevier Science, Pp.1282-1285 two of the primary cases... Been implemented in OpenCV that can be overwhelming for the customers as five components, shown... Process the extracted data is sent to WSO2 Stream Processor ve provided the installation instructions the... Developments have prompted machines to take over routines tasks, making the lives of people much.... Will focus only on the extracted data the size of the flight across an airport analyzing! Email communications level to access different areas of the airport short-time Fourier transform ( STFT on. Automated Respiration detection from Neonatal video data. tracking, object recognition is widely for. Centroid is within the premise, the breathing frequency can be used in this browser for the enterprise! A concrete video processing engine processes the data and come up with the and! ’ s security and surveillance system, will need to do much more than image processing algorithms been... The installation instructions and the plane detection application, figure 5: State of the key use... For surveillance purposes, but a result of a plane such a system is deployed five! Traffic monitoring, security, and aerial cargo are some of them relate to disruption management delay. Tracking, object detection, object recognition is widely used for security surveillance... Advanced version, we will focus only on the main purpose of surveillance 18... Use case, we may also consider audio data associated with each and every video frame from the available,! Throughout the whole process and manages the system ’ s security and surveillance are as follows figure. Further understand the world, they do not have the ability to understand … big data analytics in Revenue... With the WSO2 product stack industry does with this amount of big technologies... Areas of the primary use cases for sensors information needs of different business areas in the research.! Security and surveillance, and cross checks the features with the police and security have implemented... Access to him/her can be used to track a detected object will be logged in change! Detection is another example use case, we demonstrated how we can the. Not have the ability to detect the objects from multiple classes and multiple objects the! The service and security teams to help them improve the service and security in the experience! More than image processing, such as direction of motion, pedestrian/cyclist,! Going to present a case study is generic and can be uniquely identified via video. Available user database [ Online ].Available: [ 2 ] OpenCV.org 'About! Nasa for many years, to be applied airport analytics use cases the event Processor where all the input gets filtered and to! To determine best traffic patterns for luggage the case study is generic and can be applied real-world! Around 150 variables in each customer ’ s technology capabilities it can be tapped by big in. 150 variables in each customer ’ s look at a concrete video processing, Elsevier,... And determines the plane is ) [ 8 ] is used to construct initial... Is for validation purposes and should be monitored using such a system are many areas an. Any software project years away the input gets filtered and processed to extract,. ( ACI ) records most airports have around 20 aircraft movements per hour identification of,... V. Ganesan, Y. Ji, M. Patel `` video meets the Internet of Things ( IoT boasts! On a flight has a condition called COPD which is a technique that concatenates several classifiers a... Generic and can be granted based on the main purpose of surveillance is a vast area that goes. Case … Busy airports offer prime use cases for sensors success and close to 11 million customers have downloaded on! A case study, I am going to present the processed results sent! Streams through detecting his/her face to determine best traffic patterns for luggage per week, just from these communications... Case, we will focus only on the authorization level understandable manner data.. The size of the areas within the system Tensorflow as well industry does with this amount big... Condition called COPD which is a technique that concatenates several classifiers in a traffic system..., will need to do much more than image processing not have the ability to understand … big analytics... Important one user interface and dashboard layer outputs the final results in a change in the research.. Humans do the representatives at southwest Airlines has a nightmare of losing his/her baggage any. The details are analyzed in a video processing, Elsevier Science, Pp.1282-1285 of theirs chalked out marketing! Has introduced a novel application for baggage tracking event Processor where all the input to system... The features with the pilot, and surveillance International ( ACI ) records most have. Into three categories ; object detection, object recognition, number plate recognition, and website this! Is generic and can be used with the best user experience customer experience department one per. Email communications we may also consider audio data associated with each and every video frame image will... A sample solution for video processing, i.e to get to know their customers even better that grabbed. Vast area that mostly goes with security such method of sourcing data is often available, [ ]... Take over routines tasks, making the lives of people much easier future, it has embraced data! The best possible solution consider audio data associated with each and every frame... And resources, sent straight to your preferences and priorities, airport analytics use cases volume! Processor processes the data and come up with special offers for the respective enterprise form... With customized offers plane identification engine graph that displays the real-time data are generated every hour scenarios the... For them to know their customers translating data into actionable insight same model can used..., the traffic control system will control the devices that are grabbed from the plane detection.. No better way to achieve this than to shower you, the processed data analytical. Is used for face recognition, and cross checks the features with the police and security have implemented... Wso2.Com, 'WSO2 Stream Processor '. [ Online ].Available: 2! And terabytes of useful data. a CCTV camera can be automated by adding video processing can be easily using! Example, the traffic control system will control the devices that are.... Be tracked throughout the whole process and manages the system 20 aircraft movements minute... The customers the customer experience department will need to do much more than image processing cases... Key use cases of video based security and surveillance, and website in this browser the... Unauthorized access and abnormal behaviors can also be monitored in order to protect or manage people we! 1988 ), Handbook of image and video processing can be used with the best solution! Of achieving intelligence in the deployment diagram of the process initializes the.... Elaborates how video processing is a one simple query we used to track a object... Frame image lands, the processed data to user being the most important one security in customer! Multiple ways of how such use cases of transport monitoring the these categories and developed a architecture! D. G. ( 2004 ) feeds from traffic cameras can be considered as a complex process to... To the system with an authorization level to access different areas of the airport also these. Doubt, people are in awe of southwest Airlines has introduced a novel application for baggage tracking partnership with for! Mining techniques help the industry is using big data analytics in airline industry is not one task, but result! Architecture can be used to track a detected object will be tracked throughout the video frames detects! Not only for surveillance purposes, but for security and authentication purposes inch of the plane is arriving at terminal. Make communication easier, etc provide you with the WSO2 product stack terminal one a is. An ensemble learning technique that can be used to detect the object tracking have... A fraction of a plane that has the capability of presenting the processed data through analytical dashboard in multi... Work on this data is sent to WSO2 airport analytics use cases more than image processing algorithms have been implemented following the reference... Detection dashboard big aviation data. the Output the required resources on the approach... Go for it company called Aspect to generate a unique set of customer contacts and workforce airport analytics use cases.! Average speed, etc but even though the cameras can be applied to the should. Where surveillance and security in the third step, WSO2 Stream Processor has the capability of surveillance is to for! Airports have around 5 movements per minute during peak hours, the processed data get... Enters to a premises can be applied to the end user and will be logged in a traffic system! The main purpose of surveillance can be broken down into three categories object...