scholarly journals Long-range forecasting properties of state-of-the-art models of demand for electric energy. Volume II. Annotated bibliography

1976 ◽  
Keyword(s):  
Long Range ◽  
State Of The Art ◽  
Electric Energy ◽  
Annotated Bibliography

Centralizing Integrated Long Range Planning and Budgeting

2011 ◽  
pp. 55-75
Author(s):  
Taylor Valore
Keyword(s):  
Long Range ◽  
State Of The Art ◽  
Technical Aspects ◽  
American University ◽  
Independent Events ◽  
Long Range Planning ◽  
American University In Cairo ◽  
Annual Planning

Upon relocation to a new, state-of-the-art, 260-acre campus outside of Cairo, Egypt, the American University in Cairo (AUC) sought to revamp its annual planning and budgeting processes to address several deficiencies. Primarily, long-range planning and annual budgeting were two independent events with little synchronization. This case study will detail the process and technical aspects of AUC’s transition to a centralized and synchronized planning and budgeting cycle focused on determining appropriate workflows and leveraging database technologies to track planning initiatives throughout an approvals process. Readers will be able to weigh the drawbacks of centralization against the benefits of standardized budget review and planning.

scholarly journals A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation

2020 ◽  
Vol 8 ◽  
pp. 93-108 ◽  
Author(s):  
Jian Guan ◽  
Fei Huang ◽  
Zhihao Zhao ◽  
Xiaoyan Zhu ◽  
Minlie Huang
Keyword(s):  
Long Range ◽  
Temporal Order ◽  
State Of The Art ◽  
Knowledge Bases ◽  
Fine Tuning ◽  
Causal Relationships ◽  
Commonsense Knowledge ◽  
Language Generation ◽  
Story Generation ◽  
Global Coherence

Story generation, namely, generating a reasonable story from a leading context, is an important but challenging task. In spite of the success in modeling fluency and local coherence, existing neural language generation models (e.g., GPT-2) still suffer from repetition, logic conflicts, and lack of long-range coherence in generated stories. We conjecture that this is because of the difficulty of associating relevant commonsense knowledge, understanding the causal relationships, and planning entities and events with proper temporal order. In this paper, we devise a knowledge-enhanced pretraining model for commonsense story generation. We propose to utilize commonsense knowledge from external knowledge bases to generate reasonable stories. To further capture the causal and temporal dependencies between the sentences in a reasonable story, we use multi-task learning, which combines a discriminative objective to distinguish true and fake stories during fine-tuning. Automatic and manual evaluation shows that our model can generate more reasonable stories than state-of-the-art baselines, particularly in terms of logic and global coherence.

scholarly journals CCGbank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank

2007 ◽  
Vol 33 (3) ◽  
pp. 355-396 ◽  
Author(s):  
Julia Hockenmaier ◽  
Mark Steedman
Keyword(s):  
Long Range ◽  
State Of The Art ◽  
Categorial Grammar ◽  
Linguistic Data ◽  
Combinatory Categorial Grammar ◽  
Extensive Analysis ◽  
Dependency Structures

This article presents an algorithm for translating the Penn Treebank into a corpus of Combinatory Categorial Grammar (CCG) derivations augmented with local and long-range word-word dependencies. The resulting corpus, CCGbank, includes 99.4% of the sentences in the Penn Treebank. It is available from the Linguistic Data Consortium, and has been used to train wide-coverage statistical parsers that obtain state-of-the-art rates of dependency recovery. In order to obtain linguistically adequate CCG analyses, and to eliminate noise and inconsistencies in the original annotation, an extensive analysis of the constructions and annotations in the Penn Treebank was called for, and a substantial number of changes to the Treebank were necessary. We discuss the implications of our findings for the extraction of other linguistically expressive grammars from the Treebank, and for the design of future treebanks.

scholarly journals Self-Attention ConvLSTM for Spatiotemporal Prediction

2020 ◽  
Vol 34 (07) ◽  
pp. 11531-11538
Author(s):  
Zhihui Lin ◽  
Maomao Li ◽  
Zhuobin Zheng ◽  
Yangyang Cheng ◽  
Chun Yuan
Keyword(s):  
Long Range ◽  
State Of The Art ◽  
The Self ◽  
Time Step ◽  
Traffic Flow Prediction ◽  
Spatial Features ◽  
Gating Mechanism ◽  
Spatial Dependencies ◽  
Previous State ◽  
Global And Local

Spatiotemporal prediction is challenging due to the complex dynamic motion and appearance changes. Existing work concentrates on embedding additional cells into the standard ConvLSTM to memorize spatial appearances during the prediction. These models always rely on the convolution layers to capture the spatial dependence, which are local and inefficient. However, long-range spatial dependencies are significant for spatial applications. To extract spatial features with both global and local dependencies, we introduce the self-attention mechanism into ConvLSTM. Specifically, a novel self-attention memory (SAM) is proposed to memorize features with long-range dependencies in terms of spatial and temporal domains. Based on the self-attention, SAM can produce features by aggregating features across all positions of both the input itself and memory features with pair-wise similarity scores. Moreover, the additional memory is updated by a gating mechanism on aggregated features and an established highway with the memory of the previous time step. Therefore, through SAM, we can extract features with long-range spatiotemporal dependencies. Furthermore, we embed the SAM into a standard ConvLSTM to construct a self-attention ConvLSTM (SA-ConvLSTM) for the spatiotemporal prediction. In experiments, we apply the SA-ConvLSTM to perform frame prediction on the MovingMNIST and KTH datasets and traffic flow prediction on the TexiBJ dataset. Our SA-ConvLSTM achieves state-of-the-art results on both datasets with fewer parameters and higher time efficiency than previous state-of-the-art method.

scholarly journals Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Prediction

2021 ◽  
Author(s):  
Ruijing Yang ◽  
Ziyu Guan ◽  
Zitong Yu ◽  
Xiaoyi Feng ◽  
Jinye Peng ◽  
...  
Keyword(s):  
Long Range ◽  
Medical Diagnosis ◽  
State Of The Art ◽  
Video Sequences ◽  
Learning Framework ◽  
Remote Photoplethysmography ◽  
Spatio Temporal ◽  
Pain Recognition ◽  
Appearance Changes ◽  
Over Time

Automatic pain recognition is paramount for medical diagnosis and treatment. The existing works fall into three categories: assessing facial appearance changes, exploiting physiological cues, or fusing them in a multi-modal manner. However, (1) appearance changes are easily affected by subjective factors which impedes objective pain recognition. Besides, the appearance-based approaches ignore long-range spatial-temporal dependencies that are important for modeling expressions over time; (2) the physiological cues are obtained by attaching sensors on human body, which is inconvenient and uncomfortable. In this paper, we present a novel multi-task learning framework which encodes both appearance changes and physiological cues in a non-contact manner for pain recognition. The framework is able to capture both local and long-range dependencies via the proposed attention mechanism for the learned appearance representations, which are further enriched by temporally attended physiological cues (remote photoplethysmography, rPPG) that are recovered from videos in the auxiliary task. This framework is dubbed rPPG-enriched Spatio-Temporal Attention Network (rSTAN) and allows us to establish the state-of-the-art performance of non-contact pain recognition on publicly available pain databases. It demonstrates that rPPG predictions can be used as an auxiliary task to facilitate non-contact automatic pain recognition.

scholarly journals Normalization and De-noising of Single-cell Hi-C Data with BandNorm and 3DVI

2021 ◽  
Author(s):  
Ye Zheng ◽  
Siqi Shen ◽  
Sündüz Keleş
Keyword(s):  
Single Cell ◽  
Long Range ◽  
High Throughput ◽  
State Of The Art ◽  
Cell Types ◽  
Chromatin Conformation ◽  
Modeling Framework ◽  
Technical Noise ◽  
Generative Modeling ◽  
Downstream Analysis

AbstractSingle-cell high-throughput chromatin conformation capture methodologies (scHi-C) enable profiling long-range genomic interactions at the single-cell resolution; however, data from these technologies are prone to technical noise and bias that, when unaccounted for, hinder downstream analysis. Here we developed a fast band normalization approach, BandNorm, and a deep generative modeling framework, 3DVI, to explicitly account for scHi-C specific technical biases. We present robust performances of BandNorm and 3DVI compared to existing state-of-the-art methods. BandNorm is effective in separating cell types, identification of interaction features, and recovery of cell-cell relationship, whereas de-noising by 3DVI successfully enables 3D compartments and domains recovery, especially for rare cell types.

scholarly journals DEEPCON: protein contact prediction using dilated convolutional neural networks with dropout

2019 ◽  
Vol 36 (2) ◽  
pp. 470-477 ◽  
Author(s):  
Badri Adhikari
Keyword(s):  
Neural Networks ◽  
Long Range ◽  
Convolutional Neural Networks ◽  
High Throughput Sequencing ◽  
State Of The Art ◽  
Deep Convolutional Neural Networks ◽  
Contact Prediction ◽  
Learning Techniques ◽  
Medium Range ◽  
Art Methods

Abstract Motivation Exciting new opportunities have arisen to solve the protein contact prediction problem from the progress in neural networks and the availability of a large number of homologous sequences through high-throughput sequencing. In this work, we study how deep convolutional neural networks (ConvNets) may be best designed and developed to solve this long-standing problem. Results With publicly available datasets, we designed and trained various ConvNet architectures. We tested several recent deep learning techniques including wide residual networks, dropouts and dilated convolutions. We studied the improvements in the precision of medium-range and long-range contacts, and compared the performance of our best architectures with the ones used in existing state-of-the-art methods. The proposed ConvNet architectures predict contacts with significantly more precision than the architectures used in several state-of-the-art methods. When trained using the DeepCov dataset consisting of 3456 proteins and tested on PSICOV dataset of 150 proteins, our architectures achieve up to 15% higher precision when L/2 long-range contacts are evaluated. Similarly, when trained using the DNCON2 dataset consisting of 1426 proteins and tested on 84 protein domains in the CASP12 dataset, our single network achieves 4.8% higher precision than the ensembled DNCON2 method when top L long-range contacts are evaluated. Availability and implementation DEEPCON is available at https://github.com/badriadhikari/DEEPCON/.

scholarly journals Graph Attention Based Proposal 3D ConvNets for Action Detection

2020 ◽  
Vol 34 (04) ◽  
pp. 4626-4633 ◽  
Author(s):  
Jin Li ◽  
Xianglong Liu ◽  
Zhuofan Zong ◽  
Wanru Zhao ◽  
Mingyuan Zhang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Long Range ◽  
Convolutional Neural Networks ◽  
Adjacency Matrix ◽  
State Of The Art ◽  
Original Model ◽  
Action Detection ◽  
Model Experiments ◽  
Temporal And Spatial ◽  
Temporal Action

The recent advances in 3D Convolutional Neural Networks (3D CNNs) have shown promising performance for untrimmed video action detection, employing the popular detection framework that heavily relies on the temporal action proposal generations as the input of the action detector and localization regressor. In practice the proposals usually contain strong intra and inter relations among them, mainly stemming from the temporal and spatial variations in the video actions. However, most of existing 3D CNNs ignore the relations and thus suffer from the redundant proposals degenerating the detection performance and efficiency. To address this problem, we propose graph attention based proposal 3D ConvNets (AGCN-P-3DCNNs) for video action detection. Specifically, our proposed graph attention is composed of intra attention based GCN and inter attention based GCN. We use intra attention to learn the intra long-range dependencies inside each action proposal and update node matrix of Intra Attention based GCN, and use inter attention to learn the inter dependencies between different action proposals as adjacency matrix of Inter Attention based GCN. Afterwards, we fuse intra and inter attention to model intra long-range dependencies and inter dependencies simultaneously. Another contribution is that we propose a simple and effective framewise classifier, which enhances the feature presentation capabilities of backbone model. Experiments on two proposal 3D ConvNets based models (P-C3D and P-ResNet) and two popular action detection benchmarks (THUMOS 2014, ActivityNet v1.3) demonstrate the state-of-the-art performance achieved by our method. Particularly, P-C3D embedded with our module achieves average mAP 3.7% improvement on THUMOS 2014 dataset compared to original model.

Sign in / Sign up

Export Citation Format

Share Document