scholarly journals Video Caption Based Searching Using End-to-End Dense Captioning and Sentence Embeddings

Symmetry ◽  
2020 ◽  
Vol 12 (6) ◽  
pp. 992
Author(s):  
Akshay Aggarwal ◽  
Aniruddha Chauhan ◽  
Deepika Kumar ◽  
Mamta Mittal ◽  
Sudipta Roy ◽  
...  
Keyword(s):  
Search Space ◽  
Video Content ◽  
Video Captioning ◽  
The Past ◽  
Percentile Score ◽  
Universal Sentence ◽  
End To End ◽  
Video Searching ◽  
Searching Method

Traditionally, searching for videos on popular streaming sites like YouTube is performed by taking the keywords, titles, and descriptions that are already tagged along with the video into consideration. However, the video content is not utilized for searching of the user’s query because of the difficulty in encoding the events in a video and comparing them to the search query. One solution to tackle this problem is to encode the events in a video and then compare them to the query in the same space. A method of encoding meaning to a video could be video captioning. The captioned events in the video can be compared to the query of the user, and we can get the optimal search space for the videos. There have been many developments over the course of the past few years in modeling video-caption generators and sentence embeddings. In this paper, we exploit an end-to-end video captioning model and various sentence embedding techniques that collectively help in building the proposed video-searching method. The YouCook2 dataset was used for the experimentation. Seven sentence embedding techniques were used, out of which the Universal Sentence Encoder outperformed over all the other six, with a median percentile score of 99.51. Thus, this method of searching, when integrated with traditional methods, can help improve the quality of search results.

scholarly journals SMOS Third Mission Reprocessing after 10 Years in Orbit

2020 ◽  
Vol 12 (10) ◽  
pp. 1645 ◽  
Author(s):  
Roger Oliva ◽  
Manuel Martín-Neira ◽  
Ignasi Corbella ◽  
Josep Closa ◽  
Albert Zurita ◽  
...  
Keyword(s):  
Image Reconstruction ◽  
Third Mission ◽  
The Third ◽  
The Past ◽  
Level 1 ◽  
End To End ◽  
The One

After more than 10 years in orbit, the SMOS team has started a new reprocessing campaign for the SMOS measurements, which includes the changes in calibration and image reconstruction that have been made to the Level 1 Operational Processor (L1OP) during the past few years. The current L1 processor, version v620, was used for the second mission reprocessing in 2014. The new version, v724, is the one run in the third mission reprocessing and will become the new operational processor. The present paper explains the major changes applied and analyses the quality of the data with different metrics. The results have been obtained with numerous individual tests that have confirmed the benefits of the evolutions and an end-to-end processing campaign involving three years of data used to assess the improvements of the SMOS measurements quantitatively.

Enriching semantic search with preference and quality scores

2017 ◽  
Vol 01 (01) ◽  
pp. 1650002
Author(s):  
Michele Missikoff ◽  
Anna Formica ◽  
Elaheh Pourabbas ◽  
Francesco Taglino
Keyword(s):  
Search Space ◽  
Search Method ◽  
Semantic Search ◽  
Conceptual Similarity ◽  
Web Information ◽  
User Request ◽  
Reference Ontology ◽  
Web Information Systems ◽  
Searching Method

This paper proposes an advanced searching method, aimed at improving Web Information Systems by adopting semantic technology solutions. In particular, it first illustrates the main solutions for semantic search and then proposes the semantic search method [Formula: see text] that represents an evolution of the original SemSim method. The latter is based on the annotation of the resources in a given search space by means of Ontology Feature Vectors ([Formula: see text]), built starting from a reference ontology. Analogously, a user request is expressed as a set of keywords (concepts) selected from the reference ontology, that represent the desired characteristics of the searched resources. Then, the searching method consists in extracting the resources having the [Formula: see text] that exhibit the highest conceptual similarity to the user request. The new method, [Formula: see text], improves the above mechanism by enriching the [Formula: see text] with scores. In the user request, a score (High, Medium, Low) is associated with a concept and indicates the preference (i.e., the priority) that the user assigns to the different concepts in searching for resources. In the resource annotation, the score indicates the level of quality of the concept used to characterize the resource. The [Formula: see text] method has been experimented and the results show that it outperforms the SemSim method and, therefore, also the most representative similarity methods proposed in the literature, as already shown in previous works of the authors.

scholarly journals Video Captioning Based on Channel Soft Attention and Semantic Reconstructor

2021 ◽  
Vol 13 (2) ◽  
pp. 55
Author(s):  
Zhou Lei ◽  
Yiyong Huang
Keyword(s):  
Temporal Structure ◽  
Video Content ◽  
Global Features ◽  
Time Step ◽  
Video Captioning ◽  
3 Dimensional ◽  
Spatial Features ◽  
Video Feature ◽  
Fully Connected

Video captioning is a popular task which automatically generates a natural-language sentence to describe video content. Previous video captioning works mainly use the encoder–decoder framework and exploit special techniques such as attention mechanisms to improve the quality of generated sentences. In addition, most attention mechanisms focus on global features and spatial features. However, global features are usually fully connected features. Recurrent convolution networks (RCNs) receive 3-dimensional features as input at each time step, but the temporal structure of each channel at each time step has been ignored, which provide temporal relation information of each channel. In this paper, a video captioning model based on channel soft attention and semantic reconstructor is proposed, which considers the global information for each channel. In a video feature map sequence, the same channel of every time step is generated by the same convolutional kernel. We selectively collect the features generated by each convolutional kernel and then input the weighted sum of each channel to RCN at each time step to encode video representation. Furthermore, a semantic reconstructor is proposed to rebuild semantic vectors to ensure the integrity of semantic information in the training process, which takes advantage of both forward (semantic to sentence) and backward (sentence to semantic) flows. Experimental results on popular datasets MSVD and MSR-VTT demonstrate the effectiveness and feasibility of our model.

scholarly journals Video Captioning with Tube Features

2018 ◽  
Author(s):  
Bin Zhao ◽  
Xuelong Li ◽  
Xiaoqiang Lu
Keyword(s):  
Experimental Results ◽  
Visual Feature ◽  
Video Content ◽  
Dynamic Information ◽  
Video Captioning ◽  
Attention Model ◽  
Decoder Architecture ◽  
Benchmark Datasets

Visual feature plays an important role in the video captioning task. Considering that the video content is mainly composed of the activities of salient objects, it has restricted the caption quality of current approaches which just focus on global frame features while paying less attention to the salient objects. To tackle this problem, in this paper, we design an object-aware feature for video captioning, denoted as tube feature. Firstly, Faster-RCNN is employed to extract object regions in frames, and a tube generation method is developed to connect the regions from different frames but belonging to the same object. After that, an encoder-decoder architecture is constructed for video caption generation. Specifically, the encoder is a bi-directional LSTM, which is utilized to capture the dynamic information of each tube. The decoder is a single LSTM extended with an attention model, which enables our approach to adaptively attend to the most correlated tubes when generating the caption. We evaluate our approach on two benchmark datasets: MSVD and Charades. The experimental results have demonstrated the effectiveness of tube feature in the video captioning task.

Immunoferritin localization of intracellular antigens in positively stained frozen sections

1978 ◽  
Vol 36 (2) ◽  
pp. 168-169
Author(s):  
K. T. Tokuyasu
Keyword(s):  
Surface Tension ◽  
Water Surface ◽  
Thin Layers ◽  
The Other ◽  
Positive Staining ◽  
Frozen Sections ◽  
The Past ◽  
Ultrathin Frozen Sections ◽  
Definition Of

During the past investigations of immunoferritin localization of intracellular antigens in ultrathin frozen sections, we found that the degree of negative staining required to delineate u1trastructural details was often too dense for the recognition of ferritin particles. The quality of positive staining of ultrathin frozen sections, on the other hand, has generally been far inferior to that attainable in conventional plastic embedded sections, particularly in the definition of membranes. As we discussed before, a main cause of this difficulty seemed to be the vulnerability of frozen sections to the damaging effects of air-water surface tension at the time of drying of the sections.Indeed, we found that the quality of positive staining is greatly improved when positively stained frozen sections are protected against the effects of surface tension by embedding them in thin layers of mechanically stable materials at the time of drying (unpublished).

Exercise Capacity in Chronic Heart Failure

2012 ◽  
Vol 9 (1) ◽  
pp. 57-60 ◽  
Author(s):  
Gina G Mentzer ◽  
Alex J Auseon
Keyword(s):  
Quality Of Life ◽  
Heart Failure ◽  
Exercise Training ◽  
Exercise Capacity ◽  
Positive Impact ◽  
Pharmacologic Therapy ◽  
The Past ◽  
Diagnosis And Prognosis ◽  
Future Therapy

Heart failure (HF) affects more than 5 million people and has an increasing incidence and cost burden. Patients note symptoms of dyspnea and fatigue that result in a decreased quality of life, which has not drastically improved over the past decades despite advances in therapies. The assessment of exercise capacity can provide information regarding patient diagnosis and prognosis, while doubling as a potential future therapy. clinically, there is acceptance that exercise is safe in hf and can have a positive impact on morbidity and quality of life, although evidence for improvement in mortality is still lacking. specific prescriptions for exercise training have not been developed because many variables and confounding factors have prevented research trials from demonstrating an ideal regimen. Physicians are becoming more aware of the indices and goals for hf patients in exercise testing and therapy to provide comprehensive cardiac care. it is further postulated that a combination of exercise training and pharmacologic therapy may eventually provide the most benefits to those suffering from hf.

Bioethics In Neurospinal Patient Care

2018 ◽  
Vol 1 (2) ◽  
pp. 1
Author(s):  
Andi Asadul Islam
Keyword(s):  
Time Frame ◽  
Hippocratic Oath ◽  
Moral Vision ◽  
Human Identity ◽  
The Past ◽  
Harvey Cushing ◽  
Sharp Focus ◽  
Realistic Approach ◽  
Cord Injury

Neurosurgery is among the newest of surgical disciplines, appearing in its modern incarnation at the dawn of twentieth century with the work of Harvey Cushing and contemporaries. Neurosurgical ethics involves challenges of manipulating anatomical locus of human identity and concerns of surgeons and patients who find themselves bound together in that venture.In recent years, neurosurgery ethics has taken on greater relevance as changes in society and technology have brought novel questions into sharp focus. Change of expanded armamentarium of techniques for interfacing with the human brain and spine— demand that we use philosophical reasoning to assess merits of technical innovations.Bioethics can be defined as systematic study of moral challenges in medicine, including moral vision, decisions, conduct, and policies related to medicine. Every surgeon should still take the Hippocratic Oath seriously and consider it a basic guide to follow good medical ethics in medical practice. It is simple and embodies three of the four modern bioethics principles – Respecting autonomy, beneficence, nonmaleficence, and justice.Spinal cord injury (SCI) is a devastating condition often affecting young and healthy individuals around the world. Currently, scientists are pressured on many fronts to develop an all-encompassing “cure” for paralysis. While scientific understanding of central nervous system (CNS) regeneration has advanced greatly in the past years, there are still many unknowns with regard to inducing successful regeneration. A more realistic approach is required if we are interested in improving the quality of life of a large proportion of the paralyzed population in a more expedient time frame.

Menopausal hormone therapy and uterine cancer: the acceptability of the tandem

GYNECOLOGY ◽  
2018 ◽  
Vol 20 (6) ◽  
pp. 42-47
Author(s):  
O V Yakushevskaya ◽  
S V Yureneva ◽  
A E Protasova ◽  
G N Khabas ◽  
M R Dumanovskaya
Keyword(s):  
Hormone Therapy ◽  
Uterine Cancer ◽  
Menopausal Hormone Therapy ◽  
Medical Rehabilitation ◽  
Cytostatic Treatment ◽  
Systematic Analysis ◽  
Strict Adherence ◽  
Patient Profile ◽  
The Past

The aim of the work is to conduct a systematic analysis of the available research results on the possibility of using menopausal hormone therapy (MHT) in patients who successfully completed the treatment of endometrial cancer (EC). Materials and methods. The review includes data from foreign articles published in PubMed and Medline, and domestic works published on elibrary.ru over the past 40 years. Results. The results obtained allow us to consider MHT as an independent method of medical rehabilitation for women who have undergone EC. A clear patient profile should be established, allowing the use of this method, with strict adherence to health monitoring. Conclusion Patients who have successfully completed the treatment of EC require the creation of special rehabilitation conditions in the interests of maintaining health and quality of life and should be under the close attention of the doctor. Argumented approaches to the appointment of MHT in such patients will avoid complications associated with estrogen deficiency after surgery, radiation with or without systemic (cytostatic) treatment methods.

YEAR 2020: ON THE REMAINING REPRODUCTIVE THREATS AND THEIR NEUTRALIZATION ON THE WAYS TO IMPROVE STRATEGIC PLANNING AND INDUSTRIAL POLICY, THE DEPLOYMENT OF THE NATIONAL INNOVATION SYSTEM AND ITS SECTORAL AND REGIONAL SUBSYSTEMS

2020 ◽  
pp. 3-53
Author(s):  
Yu.B. Vinslav
Keyword(s):  
Strategic Planning ◽  
Industrial Policy ◽  
Innovation System ◽  
Poor Quality ◽  
National Innovation System ◽  
State Regulation ◽  
Industrial Complex ◽  
The Past ◽  
Technological Modernization

The article analyzes the main indicators of the evolution of the domestic economy and its industrial complex in the past year (in January — November 2019). It Identifies trends in this evolution, including negative trends that determine the preservation of reproductive threats in 2020: sluggishness, instability and low quality of economic growth. The main reasons for the fact that the objective resource capabilities of the macro level were clearly not used enough to effectively solve the urgent problems of technological modernization of the economy and increase people’s welfare are established. The main reason is the poor quality of public administration, including imperfect strategic planning and industrial policy; there is still no modern national innovation system in the country. Accordingly, recommendations for improving the quality of state regulation in its specified components are justified. The recommended measures, according to the author, will help the economy to move to a trajectory of rapid, sustainable and high-quality growth.

Sign in / Sign up

Export Citation Format

Share Document