A Study of Conceptual Recommender System for Big Data Platform

2015 ◽  
Author(s):  
Jinhong Kim ◽  
Sung-Tae Hwang
Keyword(s):  
Big Data ◽  
Recommender System ◽  
Data Platform

Construction of a multi-source heterogeneous hybrid platform for big data

2021 ◽  
pp. 1-10
Author(s):  
Ying Wang ◽  
Yiding Liu ◽  
Minna Xia
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Forest Fire ◽  
Original Data ◽  
Big Data Analysis ◽  
Multiple Sources ◽  
Data Types ◽  
Fire Monitoring ◽  
Data Platform

Big data is featured by multiple sources and heterogeneity. Based on the big data platform of Hadoop and spark, a hybrid analysis on forest fire is built in this study. This platform combines the big data analysis and processing technology, and learns from the research results of different technical fields, such as forest fire monitoring. In this system, HDFS of Hadoop is used to store all kinds of data, spark module is used to provide various big data analysis methods, and visualization tools are used to realize the visualization of analysis results, such as Echarts, ArcGIS and unity3d. Finally, an experiment for forest fire point detection is designed so as to corroborate the feasibility and effectiveness, and provide some meaningful guidance for the follow-up research and the establishment of forest fire monitoring and visualized early warning big data platform. However, there are two shortcomings in this experiment: more data types should be selected. At the same time, if the original data can be converted to XML format, the compatibility is better. It is expected that the above problems can be solved in the follow-up research.

A monitoring framework for transparency and fairness in big data platform

2021 ◽  
Author(s):  
Karima Aslaoui Mokhtari ◽  
Salima Benbernou ◽  
Mourad Ouziri ◽  
Hakim Lahmar ◽  
Muhammad Younas
Keyword(s):  
Big Data ◽  
Data Platform ◽  
Monitoring Framework

scholarly journals Application of Improved Recommendation System Based on Spark Platform in Big Data Analysis

2016 ◽  
Vol 16 (6) ◽  
pp. 245-255 ◽  
Author(s):  
Li Xie ◽  
Wenbo Zhou ◽  
Yaosen Li
Keyword(s):  
Big Data ◽  
Recommender System ◽  
Recommendation System ◽  
Parallel Implementation ◽  
Implementation Process ◽  
Recommendation Algorithm ◽  
Filtration Problem ◽  
Information Filtration ◽  
Similarity Information ◽  
Better Than

Abstract In the era of big data, people have to face information filtration problem. For those cases when users do not or cannot express their demands clearly, recommender system can analyse user’s information more proactive and intelligent to filter out something users want. This property makes recommender system play a very important role in the field of e-commerce, social network and so on. The collaborative filtering recommendation algorithm based on Alternating Least Squares (ALS) is one of common algorithms using matrix factorization technique of recommendation system. In this paper, we design the parallel implementation process of the recommendation algorithm based on Spark platform and the related technology research of recommendation systems. Because of the shortcomings of the recommendation algorithm based on ALS model, a new loss function is designed. Before the model is trained, the similarity information of users and items is fused. The experimental results show that the performance of the proposed algorithm is better than that of algorithm based on ALS.

Sign in / Sign up

Export Citation Format

Share Document