scholarly journals An integrated method for real time and offline web robot detection

2016 ◽  
Vol 33 (6) ◽  
pp. 592-606 ◽  
Author(s):  
Derek Doran ◽  
Swapna S. Gokhale
Keyword(s):  
Real Time ◽  
Integrated Method ◽  
Web Robot ◽  
Web Robot Detection

Integrated Method for Online Calibration of Real-Time Traffic Network Management Systems

2015 ◽  
Vol 2528 (1) ◽  
pp. 106-115 ◽  
Author(s):  
Hossein Hashemi ◽  
Khaled Abdelghany
Keyword(s):  
Network Management ◽  
Real Time ◽  
Simulation Models ◽  
Calibration Method ◽  
Propagation Model ◽  
Traffic Network ◽  
Operational Conditions ◽  
Online Calibration ◽  
Integrated Method ◽  
Real Time Traffic

This paper presents an integrated method for online calibration of realtime traffic network simulation models. The method integrates a time-dependent demand adjustment module and a link-based traffic flow propagation model calibration module. These modules use available realtime traffic observations to minimize inconsistency between the model estimation results and real-world observations. The modules are integrated into a real-time traffic network management system that was developed for the US-75 corridor in Dallas, Texas. Results illustrate that the online calibration method is effective in enhancing the model's consistency in the different operational conditions.

scholarly journals Research on Web Robot Detection Technology for Concept Drift

2021 ◽  
Vol 2010 (1) ◽  
pp. 012161
Author(s):  
Xue Chen ◽  
Yang Song ◽  
Wei Xiong ◽  
Yutao Lu ◽  
Xingen Wang
Keyword(s):  
Concept Drift ◽  
Web Robot ◽  
Detection Technology ◽  
Web Robot Detection

SEMANTIC APPROACH FOR WEB-ROBOT DETECTION

2019 ◽  
pp. 40-45
Author(s):  
A. A. Menshchikov ◽  
Yu. A. Gatchin
Keyword(s):  
Data Privacy ◽  
Web Server ◽  
Classification Model ◽  
Detection Accuracy ◽  
Web Resources ◽  
Web Resource ◽  
Web Robot ◽  
Efficient Detection ◽  
Selection Of ◽  
Web Robot Detection

Today modern researches suggest that robotic traffic on web resources prevails over user traffic in terms of volume and intensity. Web robots threaten data privacy, copyright, as well as affect performance, security, and affect statistics. There is a need to develop efficient detection and protection methods against web robots. Existing techniques involve the use of syntactic and analytical processing of web server logs to detect web robots. This article proposes to analyze the graph of visits of web robots, taking into account the time, as well as the connectivity of topics of the visited pages. In the article we provide an algorithm for data selection and cleansing, extracting semantic features of pages on a web resource, as well as the proposed detection parameters. We describe in detail the process of forming the ground truth and the principles of existing sessions labelling to the legit and robotic types. It is proposed to use the capabilities of a web server to identify sessions uniquely. The clustering procedure and the selection of a suitable classification model are discussed. For each of the studied models, the selection of hyper parameters and cross-validation of the results are made. The analysis of performance and detection accuracy, as well as comparison with the results of existing approaches is provided. Empirical results of the proposed method on web-resources show that this method leads to better web robot detection accuracy and precision comparing with the existing approaches.

Real-time line tracking based on web robot vision

2009 ◽  
Vol 19 (4) ◽  
pp. 806-813 ◽  
Author(s):  
Nihat Yilmaz ◽  
Seref Sagiroglu
Keyword(s):  
Real Time ◽  
Robot Vision ◽  
Time Line ◽  
Web Robot ◽  
Line Tracking

Web robot detection: A probabilistic reasoning approach

2009 ◽  
Vol 53 (3) ◽  
pp. 265-278 ◽  
Author(s):  
Athena Stassopoulou ◽  
Marios D. Dikaiakos
Keyword(s):  
Probabilistic Reasoning ◽  
Web Robot ◽  
Web Robot Detection

Content-aware web robot detection

2020 ◽  
Vol 50 (11) ◽  
pp. 4017-4028
Author(s):  
Athanasios Lagopoulos ◽  
Grigorios Tsoumakas
Keyword(s):  
Web Robot ◽  
Content Aware ◽  
Web Robot Detection
Sign in / Sign up

Export Citation Format

Share Document