Behavior Analysis Using a Multilevel Motion Pattern Learning Framework

2015 ◽  
Vol 2528 (1) ◽  
pp. 116-127 ◽  
Author(s):  
Mohamed Gomaa Mohamed ◽  
Nicolas Saunier
Keyword(s):  
Gaussian Mixture ◽  
Video Data ◽  
Road User ◽  
Pattern Learning ◽  
Data Sets ◽  
Motion Pattern ◽  
Trajectory Data ◽  
Data Set ◽  
Learning Framework ◽  
Road Users

The increasing availability of video data, through existing traffic cameras or dedicated field data collection, and the development of computer vision techniques pave the way for the collection of massive data sets about the microscopic behavior of road users. Analysis of such data sets helps in understanding normal road user behavior and can be used for realistic prediction of motion and computation of surrogate safety indicators. A multilevel motion pattern learning framework was developed to enable automated scene interpretation, anomalous behavior detection, and surrogate safety analysis. First, points of interest (POIs) were learned on the basis of the Gaussian mixture model and the expectation maximization algorithm and then used to form activity paths (APs). Second, motion patterns, represented by trajectory prototypes, were learned from road users' trajectories in each AP by using a two-stage trajectory clustering method based on spatial then temporal (speed) information. Finally, motion prediction relied on matching at each instant partial trajectories to the learned prototypes to evaluate potential for collision by using computing indicators. An intersection case study demonstrates the framework's ability in many ways: it helps reduce the computation cost up to 90%; it cleans the trajectory data set from tracking outliers; it uses actual trajectories as prototypes without any pre- and postprocessing; and it predicts future motion realistically to compute surrogate safety indicators.

scholarly journals A Distributed Content-Based Video Retrieval System for Large Data-sets

2021 ◽  
Author(s):  
ElMehdi SAOUDI ◽  
Said Jai Andaloussi
Keyword(s):  
Real Time ◽  
Retrieval System ◽  
Video Retrieval ◽  
Multimedia Databases ◽  
Video Data ◽  
Multimedia Data ◽  
Machine Learning Techniques ◽  
Data Sets ◽  
Data Set ◽  
Content Based Video Retrieval

Abstract With the rapid growth of the volume of video data and the development of multimedia technologies, it has become necessary to have the ability to accurately and quickly browse and search through information stored in large multimedia databases. For this purpose, content-based video retrieval ( CBVR ) has become an active area of research over the last decade. In this paper, We propose a content-based video retrieval system providing similar videos from a large multimedia data-set based on a query video. The approach uses vector motion-based signatures to describe the visual content and uses machine learning techniques to extract key-frames for rapid browsing and efficient video indexing. We have implemented the proposed approach on both, single machine and real-time distributed cluster to evaluate the real-time performance aspect, especially when the number and size of videos are large. Experiments are performed using various benchmark action and activity recognition data-sets and the results reveal the effectiveness of the proposed method in both accuracy and processing time compared to state-of-the-art methods.

Video Data Mining

2011 ◽  
pp. 1185-1189 ◽  
Author(s):  
Jung Hwan Oh ◽  
Jeong Kyu Lee ◽  
Sae Hwang
Keyword(s):  
Data Mining ◽  
Research Area ◽  
Multimedia Databases ◽  
Video Data ◽  
Multimedia Data ◽  
Data Sets ◽  
Data Set ◽  
Useful Knowledge ◽  
Active Research ◽  
Diverse Data

Data mining, which is defined as the process of extracting previously unknown knowledge and detecting interesting patterns from a massive set of data, has been an active research area. As a result, several commercial products and research prototypes are available nowadays. However, most of these studies have focused on corporate data — typically in an alpha-numeric database, and relatively less work has been pursued for the mining of multimedia data (Zaïane, Han, & Zhu, 2000). Digital multimedia differs from previous forms of combined media in that the bits representing texts, images, audios, and videos can be treated as data by computer programs (Simoff, Djeraba, & Zaïane, 2002). One facet of these diverse data in terms of underlying models and formats is that they are synchronized and integrated hence, can be treated as integrated data records. The collection of such integral data records constitutes a multimedia data set. The challenge of extracting meaningful patterns from such data sets has lead to research and development in the area of multimedia data mining. This is a challenging field due to the non-structured nature of multimedia data. Such ubiquitous data is required in many applications such as financial, medical, advertising and Command, Control, Communications and Intelligence (C3I) (Thuraisingham, Clifton, Maurer, & Ceruti, 2001). Multimedia databases are widespread and multimedia data sets are extremely large. There are tools for managing and searching within such collections, but the need for tools to extract hidden and useful knowledge embedded within multimedia data is becoming critical for many decision-making applications.

Optimized Video Tracking for Automated Vehicle Turning Movement Counts

2017 ◽  
Vol 2645 (1) ◽  
pp. 104-112
Author(s):  
François Bélisle ◽  
Nicolas Saunier ◽  
Guillaume-Alexandre Bilodeau ◽  
Sebastien le Digabel
Keyword(s):  
Case Studies ◽  
Traffic Engineering ◽  
Clustering Algorithm ◽  
Video Tracking ◽  
Video Data ◽  
Road User ◽  
Generalization Error ◽  
Trajectory Clustering ◽  
Peak Period ◽  
Data Set

This paper proposes a new method for automatically counting vehicle turning movements based on video tracking, expanding on previous work on optimization of parameters for road user trajectory extraction and on automated trajectory clustering. The counting method is composed of three main steps: an automated tracker that extracts vehicle trajectories from video data, an automated trajectory clustering algorithm, and an optimization algorithm. The proposed method was applied to obtain turning movement counts in three typical traffic engineering case studies in Canada representing industry-type conditions. These exhibited varying levels of tracking difficulty, ranging from a single-lane off-ramp to a six-movement intersection with a stop and a right-turn channel. Because of a limitation of the data set, giving flows per movement and not per lane, all sites were chosen with a single lane per movement. The 3-h morning peak period was used in the case studies. The results show an average weighted generalization error of 12% for more than 3,700 vehicles automatically analyzed for more than 8 h of video, ranging from 9.5% to 19.5%. The generalization error is on average 8.6% (and as low as 6.0% per movement) for the 3,084 uninterrupted vehicles that are in plain view of the camera. This paper describes in detail the methodology used and discusses the factors that affect counting performance and how to improve counting accuracy in further research.

scholarly journals Comparison of Weibull and Gaussian Mixture Models for Wind Speed Data Analysis

2020 ◽  
Vol 11 (1) ◽  
pp. 10-16
Author(s):  
Muhammad Shoaib ◽  
Saif Ur Rehman ◽  
Imran Siddiqui ◽  
Shafiqur Rehman ◽  
Shamim Khan ◽  
...  
Keyword(s):  
Wind Speed ◽  
Wind Power ◽  
Gaussian Mixture ◽  
Descriptive Statistics ◽  
Wind Data ◽  
Weibull Function ◽  
Data Sets ◽  
Data Set ◽  
Wind Speeds ◽  
Power Densities

In order to have a reliable estimate of wind energy potential of a site, high frequency wind speed and direction data recorded for an extended period of time is required. Weibull distribution function is commonly used to approximate the recorded data distribution for estimation of wind energy. In the present study a comparison of Weibull function and Gaussian mixture model (GMM) as theoretical functions are used. The data set used for the study consists of hourly wind speeds and wind directions of 54 years duration recorded at Ijmuiden wind site located in north of Holland. The entire hourly data set of 54 years is reduced to 12 sets of hourly averaged data corresponding to 12 months. Authenticity of data is assessed by computing descriptive statistics on the entire data set without average and on monthly 12 data sets. Additionally, descriptive statistics show that wind speeds are positively skewed and most of the wind data points are observed to be blowing in south-west direction. Cumulative distribution and probability density function for all data sets are determined for both Weibull function and GMM. Wind power densities on monthly as well as for the entire set are determined from both models using probability density functions of Weibull function and GMM. In order to assess the goodness-of-fit of the fitted Weibull function and GMM, coefficient of determination (R2) and Kolmogorov-Smirnov (K-S) tests are also determined. Although R2 test values for Weibull function are much closer to ‘1’ compared to its values for GMM. Nevertheless, overall performance of GMM is superior to Weibull function in terms of estimated wind power densities using GMM which are in good agreement with the power densities estimated using wind data for the same duration. It is reported that wind power densities for the entire wind data set are 307 W/m2 and 403.96 W/m2 estimated using GMM and Weibull function, respectively.

scholarly journals Petrophysically and geologically guided multi-physics inversion using a dynamic Gaussian mixture model

2020 ◽  
Vol 224 (1) ◽  
pp. 40-68 ◽  
Author(s):  
Thibaut Astic ◽  
Lindsey J Heagy ◽  
Douglas W Oldenburg
Keyword(s):  
Gaussian Mixture Model ◽  
Mixture Model ◽  
Gaussian Mixture ◽  
Quantitative Information ◽  
Geophysical Data ◽  
Magnetic Data ◽  
Data Sets ◽  
Data Set ◽  
Geophysical Surveys ◽  
Geological Information

SUMMARY In a previous paper, we introduced a framework for carrying out petrophysically and geologically guided geophysical inversions. In that framework, petrophysical and geological information is modelled with a Gaussian mixture model (GMM). In the inversion, the GMM serves as a prior for the geophysical model. The formulation and applications were confined to problems in which a single physical property model was sought, and a single geophysical data set was available. In this paper, we extend that framework to jointly invert multiple geophysical data sets that depend on multiple physical properties. The petrophysical and geological information is used to couple geophysical surveys that, otherwise, rely on independent physics. This requires advancements in two areas. First, an extension from a univariate to a multivariate analysis of the petrophysical data, and their inclusion within the inverse problem, is necessary. Secondly, we address the practical issues of simultaneously inverting data from multiple surveys and finding a solution that acceptably reproduces each one, along with the petrophysical and geological information. To illustrate the efficacy of our approach and the advantages of carrying out multi-physics inversions coupled with petrophysical and geological information, we invert synthetic gravity and magnetic data associated with a kimberlite deposit. The kimberlite pipe contains two distinct facies embedded in a host rock. Inverting the data sets individually, even with petrophysical information, leads to a binary geological model: background or undetermined kimberlite. A multi-physics inversion, with petrophysical information, differentiates between the two main kimberlite facies of the pipe. Through this example, we also highlight the capabilities of our framework to work with interpretive geological assumptions when minimal quantitative information is available. In those cases, the dynamic updates of the GMM allow us to perform multi-physics inversions by learning a petrophysical model.

Content-Based Video Scene Clustering and Segmentation

2011 ◽  
pp. 166-179
Author(s):  
Hong Lu ◽  
Xiangyang Xue
Keyword(s):  
Large Scale ◽  
Video Summarization ◽  
Gaussian Mixture ◽  
Visual Similarity ◽  
Video Data ◽  
Data Sets ◽  
Scene Segmentation ◽  
Clustering Methods ◽  
Video Frames ◽  
Video Scene

With the amount of video data increasing rapidly, automatic methods are needed to deal with large-scale video data sets in various applications. In content-based video analysis, a common and fundamental preprocess for these applications is video segmentation. Based on the segmentation results, video has a hierarchical representation structure of frames, shots, and scenes from the low level to high level. Due to the huge amount of video frames, it is not appropriate to represent video contents using frames. In the levels of video structure, shot is defined as an unbroken sequence of frames from one camera; however, the contents in shots are trivial and can hardly convey valuable semantic information. On the other hand, scene is a group of consecutive shots that focuses on an object or objects of interest. And a scene can represent a semantic unit for further processing such as story extraction, video summarization, etc. In this chapter, we will survey the methods on video scene segmentation. Specifically, there are two kinds of scenes. One kind of scene is to just consider the visual similarity of video shots and clustering methods are used for scene clustering. Another kind of scene is to consider both the visual similarity and temporal constraints of video shots, i.e., shots with similar contents and not lying too far in temporal order. Also, we will present our proposed methods on scene clustering and scene segmentation by using Gaussian mixture model, graph theory, sequential change detection, and spectral methods.

scholarly journals Investigation of Pig Activity Based on Video Data and Semi-Supervised Neural Networks

2020 ◽  
Vol 2 (4) ◽  
pp. 581-595
Author(s):  
Martin Wutke ◽  
Armin Otto Schmitt ◽  
Imke Traulsen ◽  
Mehmet Gültas
Keyword(s):  
Neural Networks ◽  
Early Warning Systems ◽  
The State ◽  
Video Data ◽  
Activity Level ◽  
Data Sets ◽  
Complex Scene ◽  
Data Set ◽  
Stress Indicator ◽  
Tail Biting

The activity level of pigs is an important stress indicator which can be associated to tail-biting, a major issue for animal welfare of domestic pigs in conventional housing systems. Although the consideration of the animal activity could be essential to detect tail-biting before an outbreak occurs, it is often manually assessed and therefore labor intense, cost intensive and impracticable on a commercial scale. Recent advances of semi- and unsupervised convolutional neural networks (CNNs) have made them to the state of art technology for detecting anomalous behavior patterns in a variety of complex scene environments. In this study we apply such a CNN for anomaly detection to identify varying levels of activity in a multi-pen problem setup. By applying a two-stage approach we first trained the CNN to detect anomalies in the form of extreme activity behavior. Second, we trained a classifier to categorize the detected anomaly scores by learning the potential activity range of each pen. We evaluated our framework by analyzing 82 manually rated videos and achieved a success rate of 91%. Furthermore, we compared our model with a motion history image (MHI) approach and a binary image approach using two benchmark data sets, i.e., the well established pedestrian data sets published by the University of California, San Diego (UCSD) and our pig data set. The results show the effectiveness of our framework, which can be applied without the need of a labor intense manual annotation process and can be utilized for the assessment of the pig activity in a variety of applications like early warning systems to detect changes in the state of health.

Supervised Learning Methods in Classifying Organized Behavior in Tweet Collections

2019 ◽  
Vol 28 (06) ◽  
pp. 1960001
Author(s):  
Erdem Beğenilmiş ◽  
Susan Uskudarli
Keyword(s):  
Supervised Learning ◽  
Gaussian Mixture ◽  
Data Sets ◽  
Random Forest Algorithm ◽  
Learning Methods ◽  
Data Set ◽  
Behavioral Features ◽  
Use Of Social Media ◽  
The Uk ◽  
F Measure

The successful use of social media to manipulate public opinion via bots and hired individuals to spread (mis)information to unsuspecting users reached alarming levels due to the manipulations during the 2016 US elections and the Brexit deliberations in the UK. Fake interaction such as “liking” and “retweeting” are staged to foster trust in the posts of bots and individuals, which makes it difficult for individuals to detect the posts that are part of greater schemes. We propose an approach based on supervised learning to classify collections of tweets as “organized” when they inhabit premeditated intent and as “organic” otherwise. Features related to users and posting behavior are used to train the classifiers using 851 data sets totaling above 270 million tweets. Further classifiers are trained to assess the effectiveness of the selected features. The random forest algorithm persistently yielded the best results with scores greater than 95% for both accuracy and f-measure. For comparison purposes, unsupervised learning methods were used to cluster the same data sets. The Gaussian Mixture Model clustered [organized vs organic] data set with 99% agreement with the labels. The success of using only behavioral features to detect organized behavior is encouraging.

scholarly journals Systematic exploration of unsupervised methods for mapping behavior

2016 ◽  
Author(s):  
Jeremy G. Todd ◽  
Jamey S. Kain ◽  
Benjamin L. de Bivort
Keyword(s):  
Gaussian Mixture ◽  
Data Sets ◽  
Clustering Methods ◽  
Cluster Assignment ◽  
Data Set ◽  
Behavioral Transitions ◽  
Assignment Algorithm ◽  
Higher Dimensional ◽  
Systematic Exploration ◽  
Components Analysis

AbstractTo fully understand the mechanisms giving rise to behavior, we need to be able to precisely measure it. When coupled with large behavioral data sets, unsupervised clustering methods offer the potential of unbiased mapping of behavioral spaces. However, unsupervised techniques to map behavioral spaces are in their infancy, and there have been few systematic considerations of all the methodological options. We compared the performance of seven distinct mapping methods in clustering a data set consisting of the x-and y-positions of the six legs of individual flies. Legs were automatically tracked by small pieces of fluorescent dye, while the fly was tethered and walking on an air-suspended ball. We find that there is considerable variation in the performance of these mapping methods, and that better performance is attained when clustering is done in higher dimensional spaces (which are otherwise less preferable because they are hard to visualize). High dimensionality means that some algorithms, including the non-parametric watershed cluster assignment algorithm, cannot be used. We developed an alternative watershed algorithm which can be used in high-dimensional spaces when the probability density estimate can be computed directly. With these tools in hand, we examined the behavioral space of fly leg postural dynamics and locomotion. We find a striking division of behavior into modes involving the fore legs and modes involving the hind legs, with few direct transitions between them. By computing behavioral clusters using the data from all flies simultaneously, we show that this division appears to be common to all flies. We also identify individual-to-individual differences in behavior and behavioral transitions. Lastly, we suggest a computational pipeline that can achieve satisfactory levels of performance without the taxing computational demands of a systematic combinatorial approach.AbbreviationsGMM: Gaussian mixture model; PCA: principal components analysis; SW: sparse watershed; t-SNE: t-distributed stochastic neighbor embedding

scholarly journals TRAJECTORY EXTRACTION FOR ANALYSIS OF UNSAFE DRIVING BEHAVIOUR

2019 ◽  
Vol XLII-2/W13 ◽  
pp. 1573-1578 ◽  
Author(s):  
C. Koetsier ◽  
S. Busch ◽  
M. Sester
Keyword(s):  
Video Data ◽  
Road User ◽  
Surveillance Video ◽  
Real Time Processing ◽  
Video Cameras ◽  
Movement Trajectories ◽  
Driving Behaviour ◽  
Road Users ◽  
Human Driver ◽  
Public Areas

<p><strong>Abstract.</strong> The environment of the vehicle can significantly influence the driving situation. Which conditions lead to unsafe driving behaviour is not always clear, also not to a human driver, as the causes might be unconscious, and thus cannot be revealed by expert interviews. Therefore, it is important to investigate how such situations can be reliably detected, and then search for their triggers. It is conceivable that such insecure situations (e.g. near-accidents, U-turns, avoiding obstacles) are reflected, for example, as anomalies in the movement trajectories of road users.</p><p>Collecting real world traffic data in driving studies is very time consuming and expensive. However, a lot of roads or public areas are already monitored with video cameras. In addition, nowadays more and more of such video data is made publicly available over the internet so that the amount of free video data is increasing. This research will exploit the use of such kind of opportunistic VGI. In the paper the first step of an automatic analysis are presented, namely: to introduce a real time processing pipeline to extract road user trajectories from surveillance video data.</p>

Sign in / Sign up

Export Citation Format

Share Document