FPM: A Collection of Large-scale Foundation Pre-trained Language Models

Recent work in language modeling has shown that train- ing large-scale Transformer models has promoted the lat- est developments in natural language processing applica- tions. However, there is very little work to unify the cur- rent effective models. In this work, we use the current ef- fective model structure to launch a model set through the current most mainstream technology. We think this will become the basic model in the future. For Chinese, us- ing the GPT-2[9] model, a 10.3 billion parameter language model was trained on the Chinese dataset, and, in particu- lar, a 2.9 billion parameter language model based on dia- logue data was trained; the BERT model was trained on the Chinese dataset with 495 million parameters; the Trans- former model has trained a language model with 5.6 bil- lion parameters on the Chinese dataset. In English, cor- responding training work has also been done. Using the GPT-2 model, a language model with 6.4 billion param- eters was trained on the English dataset; the BERT[3] model trained a language model with 1.24 billion param- eters on the English dataset, and in particular, it trained a 688 million parameter based on single card training tech- nology Language model; Transformer model trained a lan- guage model with 5.6 billion parameters on the English dataset. In the TNEWS classification task evaluated by CLUE[13], the BERT-C model exceeded the 59.46% accu- racy of ALBERT-xxlarge with an accuracy rate of 59.99%, an increase of 0.53%. In the QQP classification task evalu- ated by GLUE[11], the accuracy rate of 78.95% surpassed the accuracy rate of BERT-Large of 72.1%, an increase of 6.85%. Compared with the current accuracy rate of ERNIE, the first place in the GLUE evaluation of 75.2%, an increase of 3.75%.

CREATION AND VISUALIZATION OF AN OPERATIONAL PARAMETERS ARCHIVE

The developed methodologies allows visualizing the behavior of limiting param- eters over time and identifying patterns in the dynamics of changes in the parameters of a nuclear power unit, as well as determining if any of the parameters intersects the safe opera- tion settings. The relevance of the work is due to the importance of high-quality processing and visualization of data from the nuclear reactor archive using modern effective methodolo- gies. Also, the development of new approaches to the analysis of archived data can improve the efficiency of power plant operators.

RESEARCH OF HEAT TENSION OF GRINDING PROCESS OF CYLINDRICAL SURFACES BY PERIPHERY OF ORIENTED CIRCLE IN BLUNTING MODE

The final surface quality of the part and its geometric dimensions are formed by grinding operations.Research of the param-eters of grinding with an oriented tool in the blunting mode is an urgent task, since it will provide an increase in processing productivity. The operation of the tool in the bluntness mode provides the necessary geometric shapes of the part and surface roughness.On the other hand, this operating mode of the wheel is accompanied by clogging and a decrease in the cutting ability of the tool.Therefore, it is necessary to research the heat tension of the grinding process under these processing conditions. Methods of deep grinding with crossed axes of the tool and cylindrical part are considered.The results of an experimental research of finishing single-pass grinding of a cylindrical surface of a shaft with an oriented tool are presented.The features of the process of grinding work pieces made of plastic materials are considered.Lack of research on the heat tension of the process of grinding cylindrical surfaces by the periphery of an oriented circle in the bluntness mode. To research the heat tension of the process of grinding cylindrical surfaces by the periphery of an oriented circle in the bluntness mode. To analyze the influence of the constituent forces of grinding on the processing process. During the operation of the wheel in the bluntness mode, its cutting ability decreases and the heat tension of the grinding process and vibration increases.At the same time, the necessary geometric shape of the circle is created, which provides the specified roughness and dimensions of the part. The heat tension of the process of grinding cylindrical surfaces by the periphery of an oriented circle during its operation in the blunting mode is researched.According to the calculations, the tangential component of the grinding forces from the plastically deforming and cutting grains does not have a significant effect on the temperature rise at the calibration section.

ABOUT USING FUZZY LOGIC APPROACH TO IMPROVE ACCURACY OF MINE VENTILATION NETWORK MODELS IN ENGINEERING SUPPORT TASK SOLVING DURING MINE RESCUE OPERATIONS

In this paper the possibility of using fuzzy logic approach in the predicting of param-eters of mine ventilation network model in engineering support task solving during mine res-cue operators is described. The structure and elemental composition of predicting system of parameters of mine ventilation network is offered. Estimation of discrete factors influence on parameters of the mine ventilation network changing is carried out. Regression model for di-rect using without fuzzy logic systems implementation environment is released.

PSYCHOPHYSIOLOGICAL MARKERS OF PSYCHOLOGICAL READINESS FOR ACTIVITY IN STRESSFUL CONDITIONS

The article discusses the influence of inhibitory processes as psychophysiological characteristics that can influence the development of psychological readiness for activity in young men and women in modern stressful conditions. Inhibitory control is considered as a psychophysiological characteristic responsible for cognitive inhibition and suppression of a certain type of behavior. In the study presented in the article, the level of resilience and viability and inhibitory control is recorded. To achieve the goal of the study, the following methods were selected: “Resilience Test” (D.A. Leontiev, E.I. Rasskazova), which is an adaptation of the Hardiness Survey questionnaire, developed by the American psychologist S. Maddi. The use of this method allowed us to deter-mine the respondents ' level of resilience. Since there are a number of studies indicating that re-silience is often due to the viability of a person, we used the method of assessing the quality of life “Sf-36 Health Status Survey”as an auxiliary tool (I.A. Guidarov, V.A. Polessky). The as-sessment of the braking control in the respondents was carried out by means of the reflexometric technique “ReBOS” (author-developer: E.G. Vergunov), which allows us to evaluate the param-eters of both simple and complex sensorimotor reactions. According to the number of errors made during the experimental study, the respondents form a diagnostic opinion about the level of formation of the brake control. The results obtained suggest that not all young men and wom-en who took part in the pilot experimental study have the proper level of resilience and are able to independently build a behavior strategy that allows them to effectively counteract stressful situations. Boys and girls with a low level of resilience demonstrate a low level of formation of brake control, boys and girls who have a higher level of resilience have a more plastic nervous system, which indicates a higher level of formation of brake control. It can be assumed that these students have more pronounced adaptive capabilities in a changing environment.

BANK LENDING: OPPORTUNITIES, LIMITATIONS AND REGULATORY INSTRUMENTS

The article deals with the problems of forming the system foundations of bank lending, its resource con-ditions, volume indicators, structure and dynamics. From a theoretical and practical point of view, the param-eters of the factors that affect the limitations of credit banking activity, the relevance of finding the most ap-propriate and effective methods for regulating changes and transformations in the segmentation of credit po-tential are clarified. The approaches to the analysis and evaluation of individual instruments of credit regulation are clarified.

Patient-Specific Safe Zone Based on Daily Positions and Range of Motion

Cup orientation is a challenging step in total hip arthroplasty (THA), to ensure comfort of the patient and durability of the prosthesis. The safe zone defined by Lewinnek is commonly used for cup orientation, but it is nowadays being questioned because it is not patient-specific.We propose to define a new safe zone for cup orientation, that considers patient-specific parameters such as the pelvic tilt and the range of motion (ROM) of the leg.We developed a software that easily computes a unique safe zone from these param- eters in different daily positions, ensuring a cup orientation without risks of prosthetic impingement.

SUBSTANTIATION OF TECHNOLOGICAL PARAMETERS OF SPIRAL ROLL OF MACHINE ROLLER- BEDFORMER FOR HARVESTING ONIONS

When harvesting onions, it is very important to maintain the soil in a loosened state, since the slotted working bodies used in the separation are not able to separate the soil impurities from the bulbs, since it is small and when separating from the soil impurities it is difficult to separate. Qualitative indicators of cleaning are deter-mined by how well the previous technological operations are performed. A specific feature of onion harvesting is the need for such an agrotechnical technique as ripening and drying the bulbs after removing them from the soil. The high-quality work of the harvesting machines, both in two-phase and single-phase methods of harvesting, is ensured by satisfactory preparation of the field before harvesting. Consideration is given to improving the quali-ty indicators of mechanized harvesting of onion-seedlings, due to the unsatisfactory process of separating the bulbs from solid soil lumps, due to the fact that the slotted working bodies used in the separation are not able to isolate solid lumps comparable in size to the pile of onions. In order to intensify the harvesting process, onion sets when selecting from rolls, in order to exclude or reduce the take-up and pick-up part, together with the bulbs of soil lumps and feed the onion pile to the separating working parts, a roller-bedformer is used as part of the machine for the first phase of onion harvesting. The article presents a constructive-technological scheme and a general view of a roller-bedformer that intensifies the process of separation of onions in the second phase of harvesting. The article reflects the results of theoretical studies on the substantiation of the technological param-eters of spiral roll of machine roller-bedformer for harvesting onions.

The role of different meaninigs of ethnic function of images in change of the indicators of the intelligence level

The results of the earlier performed research indicate the existence of a relationship between the param- eters of the ethno-functional development of the individual and the indicators of the level of reproductive and creative intelligence, as well as the conditionality of these indicators by the increasing ethno-integrating natural and natural-animistic images in adult respondents in the process of psychologic correction have been obtained. These results confirmed the results of previous studies. It was also shown that ethno-differentiat- ing natural and natural-animistic representations cause the decrease of the index of harmony of the interac- tion of cognitive and emotional-sensual components of relations that characterize, among other things, the level of reproductive intelligence (according to the Rorschach-test).

Emerging Myanma—From Regime to Reforms

During decades of isolation beginning from 1962 and lasting till 2011, Myanmar seriously suffered from international sanctions. Ruled by the military regime, the country was doomed to economic and social failure. Studying the process of its transformation seems to be very interesting both from business and scientific points of view, and this is the main purpose of the paper. The literature and information about Myanmar's reforms are considerably limited and it is deeply justified to contribute to the knowledge on this fast emerging country. The methodology used in this article is based on the analysis of the existing statistical data, coming from international reports and statistic yearbooks. The basic param-eters of these analyses concern macroeconomic and social indicators. Comparisons with The Association of Southeast Asian Nations (ASEAN) countries are critical for the conclusions drawn in this article. On its way to the formation of a democratic society Myanmar faced a lot of problems. Some of them, such as the unsolved Rohingya refugee crisis, have had a bad effect not only on domestic reforms, but also a global effect, sometimes recognized as an international crisis. For business, Myanmar is one of the fastest growing economy in the world with a population of 51 million, which makes it an attractive market. The GDP per capita in Myanmar is low, so the domestic market guarantees a growing demand.