Hasil untuk "Industrial engineering. Management engineering"

Menampilkan 20 dari ~11144694 hasil · dari DOAJ, arXiv, Semantic Scholar, CrossRef

JSON API
DOAJ Open Access 2025
Ergonomic analysis of book web services’ interfaces

Patrycja Kłodnicka, Dawid Matraszek

The success of a website depends heavily on the quality of an interface, which is assessed by a few factors: functionality, aesthetics, ergonomics. The objectives of this work's research are two web services dedicated to books, Lubimyczytać and Bookworm. In this study two experiments were conducted: eye tracking and a cognitive journey. In both cases, participants received a few problems to solve. Participants also filled out surveys that asked for their feedback. The research revealed issues with usability of the both interfaces. Lubimyczytać was found to be the winner of this comparison. In order to draw correct conclusions, it was necessary to take into consideration different aspects of examined applications: readability, web page’s logical layout. Mentioned points made tasks faster and easier to complete.

Information technology, Electronic computers. Computer science
DOAJ Open Access 2025
Integrating Physical Unclonable Functions with Machine Learning for the Authentication of Edge Devices in IoT Networks

Abdul Manan Sheikh, Md. Rafiqul Islam, Mohamed Hadi Habaebi et al.

Edge computing (EC) faces unique security threats due to its distributed architecture, resource-constrained devices, and diverse applications, making it vulnerable to data breaches, malware infiltration, and device compromise. The mitigation strategies against EC data security threats include encryption, secure authentication, regular updates, tamper-resistant hardware, and lightweight security protocols. Physical Unclonable Functions (PUFs) are digital fingerprints for device authentication that enhance interconnected devices’ security due to their cryptographic characteristics. PUFs produce output responses against challenge inputs based on the physical structure and intrinsic manufacturing variations of an integrated circuit (IC). These challenge-response pairs (CRPs) enable secure and reliable device authentication. Our work implements the Arbiter PUF (APUF) on Altera Cyclone IV FPGAs installed on the ALINX AX4010 board. The proposed APUF has achieved performance metrics of 49.28% uniqueness, 38.6% uniformity, and 89.19% reliability. The robustness of the proposed APUF against machine learning (ML)-based modeling attacks is tested using supervised Support Vector Machines (SVMs), logistic regression (LR), and an ensemble of gradient boosting (GB) models. These ML models were trained over more than 19K CRPs, achieving prediction accuracies of 61.1%, 63.5%, and 63%, respectively, thus cementing the resiliency of the device against modeling attacks. However, the proposed APUF exhibited its vulnerability to Multi-Layer Perceptron (MLP) and random forest (RF) modeling attacks, with 95.4% and 95.9% prediction accuracies, gaining successful authentication. APUFs are well-suited for device authentication due to their lightweight design and can produce a vast number of challenge-response pairs (CRPs), even in environments with limited resources. Our findings confirm that our approach effectively resists widely recognized attack methods to model PUFs.

Information technology
arXiv Open Access 2025
KARMA Approach supporting Development Process Reconstruction in Model-based Systems Engineering

Jiawei Li, Zan Liang, Guoxin Wang et al.

Model reconstruction is a method used to drive the development of complex system development processes in model-based systems engineering. Currently, during the iterative design process of a system, there is a lack of an effective method to manage changes in development requirements, such as development cycle requirements and cost requirements, and to realize the reconstruction of the system development process model. To address these issues, this paper proposes a model reconstruction method to support the development process model. Firstly, the KARMA language, based on the GOPPRR-E metamodeling method, is utilized to uniformly formalize the process models constructed based on different modeling languages. Secondly, a model reconstruction framework is introduced. This framework takes a structured development requirements based natural language as input, employs natural language processing techniques to analyze the development requirements text, and extracts structural and optimization constraint information. Then, after structural reorganization and algorithm optimization, a development process model that meets the development requirements is obtained. Finally, as a case study, the development process of the aircraft onboard maintenance system is reconstructed. The results demonstrate that this method can significantly enhance the design efficiency of the development process.

en cs.SE
arXiv Open Access 2025
Robust blue-green urban flood risk management optimised with a genetic algorithm for multiple rainstorm return periods

Asid Ur Rehman, Vassilis Glenis, Elizabeth Lewis et al.

Flood risk managers seek to optimise Blue-Green Infrastructure (BGI) designs to maximise return on investment. Current systems often use optimisation algorithms and detailed flood models to maximise benefit-cost ratios for single rainstorm return periods. However, these schemes may lack robustness in mitigating flood risks across different storm magnitudes. For example, a BGI scheme optimised for a 100-year return period may differ from one optimised for a 10-year return period. This study introduces a novel methodology incorporating five return periods (T = 10, 20, 30, 50, and 100 years) into a multi-objective BGI optimisation framework. The framework combines a Non-dominated Sorting Genetic Algorithm II (NSGA-II) with a fully distributed hydrodynamic model to optimise the spatial placement and combined size of BGI features. For the first time, direct damage cost (DDC) and expected annual damage (EAD), calculated for various building types, are used as risk objective functions, transforming a many-objective problem into a multi-objective one. Performance metrics such as Median Risk Difference (MedRD), Maximum Risk Difference (MaxRD), and Area Under Pareto Front (AUPF) reveal that a 100-year optimised BGI design performs poorly when evaluated for other return periods, particularly shorter ones. In contrast, a BGI design optimised using composite return periods enhances performance metrics across all return periods, with the greatest improvements observed in MedRD (22%) and AUPF (73%) for the 20-year return period, and MaxRD (23%) for the 50-year return period. Furthermore, climate uplift stress testing confirms the robustness of the proposed design to future rainfall extremes. This study advocates a paradigm shift in flood risk management, moving from single maximum to multiple rainstorm return period-based designs to enhance resilience and adaptability to future climate extremes.

en cs.NE, cs.CE
arXiv Open Access 2025
Digital Twins for Software Engineering Processes

Robin Kimmel, Judith Michael, Andreas Wortmann et al.

Digital twins promise a better understanding and use of complex systems. To this end, they represent these systems at their runtime and may interact with them to control their processes. Software engineering is a wicked challenge in which stakeholders from many domains collaborate to produce software artifacts together. In the presence of skilled software engineer shortage, our vision is to leverage DTs as means for better rep- resenting, understanding, and optimizing software engineering processes to (i) enable software experts making the best use of their time and (ii) support domain experts in producing high-quality software. This paper outlines why this would be beneficial, what such a digital twin could look like, and what is missing for realizing and deploying software engineering digital twins.

en cs.SE
DOAJ Open Access 2024
Синтез математичної моделі зі зсувом часу комбінованого сигналу з лінійною та кубічною модуляцією частоти

О. О. Костиря, А. А. Гризо, О. М. Додух

Роботу присвячено синтезу радіолокаційних сигналів зі зниженим рівнем бічних пелюсток їх автокореляційних функцій. Для цього пропонується застосовувати комбіновані сигнали, які складаються з послідовно поєднаних у часі фрагментів з лінійним та кубічним законами внутрішньо-імпульсної частотної модуляції. Об’єктом дослідження є математична модель такого сигналу. Дослідження проводяться з використанням методів диференційно-інтегрального аналізу, математичного моделювання та порівняльного аналізу. Результатом досліджень є синтез нового двофрагментного комбінованого сигналу. На відміну від відомого сигналу з першим лінійно- та другим кубічно-частотно модульованим фрагментами нову математичну модель розроблено для випадку зсунутого часу. Результати математичного моделювання свідчать про відсутність частотно-фазових спотворень запропонованого комбінованого сигналу, що є ознакою адекватності та працездатності розробленої математичної моделі, яку можна використовувати для розширення номенклатури застосовуваних сигналів радіоелектронних засобів різного призначення.

Information technology
DOAJ Open Access 2024
Optimizing Dynamic Mode Decomposition for Video Denoising via Plug-and-Play Alternating Direction Method of Multipliers

Hyoga Yamamoto, Shunki Anami, Ryo Matsuoka

Dynamic mode decomposition (DMD) is a powerful tool for separating the background and foreground in videos. This algorithm decomposes a video into dynamic modes, called DMD modes, to facilitate the extraction of the near-zero mode, which represents the stationary background. Simultaneously, it captures the evolving motion in the remaining modes, which correspond to the moving foreground components. However, when applied to noisy video, this separation leads to degradation of the background and foreground components, primarily due to the noise-induced degradation of the DMD mode. This paper introduces a novel noise removal method for the DMD mode in noisy videos. Specifically, we formulate a minimization problem that reduces the noise in the DMD mode and the reconstructed video. The proposed problem is solved using an algorithm based on the plug-and-play alternating direction method of multipliers (PnP-ADMM). We applied the proposed method to several video datasets with different levels of artificially added Gaussian noise in the experiment. Our method consistently yielded superior results in quantitative evaluations using peak-signal-to-noise ratio (PSNR) and structural similarity (SSIM) compared to naive noise removal methods. In addition, qualitative comparisons confirmed that our method can restore higher-quality videos than the naive methods.

Applied mathematics. Quantitative methods
arXiv Open Access 2024
System Reliability Engineering in the Age of Industry 4.0: Challenges and Innovations

Antoine Tordeux, Tim M. Julitz, Isabelle Müller et al.

In the era of Industry 4.0, system reliability engineering faces both challenges and opportunities. On the one hand, the complexity of cyber-physical systems, the integration of novel numerical technologies, and the handling of large amounts of data pose new difficulties for ensuring system reliability. On the other hand, innovations such as AI-driven prognostics, digital twins, and IoT-enabled systems enable the implementation of new methodologies that are transforming reliability engineering. Condition-based monitoring and predictive maintenance are examples of key advancements, leveraging real-time sensor data collection and AI to predict and prevent equipment failures. These approaches reduce failures and downtime, lower costs, and extend equipment lifespan and sustainability. However, it also brings challenges such as data management, integrating complexity, and the need for fast and accurate models and algorithms. Overall, the convergence of advanced technologies in Industry 4.0 requires a rethinking of reliability tasks, emphasising adaptability and real-time data processing. In this chapter, we propose to review recent innovations in the field, related methods and applications, as well as challenges and barriers that remain to be explored. In the red lane, we focus on smart manufacturing and automotive engineering applications with sensor-based monitoring and driver assistance systems.

en cs.CY
arXiv Open Access 2024
Generative Software Engineering

Yuan Huang, Yinan Chen, Xiangping Chen et al.

The rapid development of deep learning techniques, improved computational power, and the availability of vast training data have led to significant advancements in pre-trained models and large language models (LLMs). Pre-trained models based on architectures such as BERT and Transformer, as well as LLMs like ChatGPT, have demonstrated remarkable language capabilities and found applications in Software engineering. Software engineering tasks can be divided into many categories, among which generative tasks are the most concern by researchers, where pre-trained models and LLMs possess powerful language representation and contextual awareness capabilities, enabling them to leverage diverse training data and adapt to generative tasks through fine-tuning, transfer learning, and prompt engineering. These advantages make them effective tools in generative tasks and have demonstrated excellent performance. In this paper, we present a comprehensive literature review of generative tasks in SE using pre-trained models and LLMs. We accurately categorize SE generative tasks based on software engineering methodologies and summarize the advanced pre-trained models and LLMs involved, as well as the datasets and evaluation metrics used. Additionally, we identify key strengths, weaknesses, and gaps in existing approaches, and propose potential research directions. This review aims to provide researchers and practitioners with an in-depth analysis and guidance on the application of pre-trained models and LLMs in generative tasks within SE.

en cs.SE
arXiv Open Access 2024
Teaching Software Metrology: The Science of Measurement for Software Engineering

Paul Ralph, Miikka Kuutila, Hera Arif et al.

While the methodological rigor of computing research has improved considerably in the past two decades, quantitative software engineering research is hampered by immature measures and inattention to theory. Measurement-the principled assignment of numbers to phenomena-is intrinsically difficult because observation is predicated upon not only theoretical concepts but also the values and perspective of the research. Despite several previous attempts to raise awareness of more sophisticated approaches to measurement and the importance of quantitatively assessing reliability and validity, measurement issues continue to be widely ignored. The reasons are unknown, but differences in typical engineering and computer science graduate training programs (compared to psychology and management, for example) are involved. This chapter therefore reviews key concepts in the science of measurement and applies them to software engineering research. A series of exercises for applying important measurement concepts to the reader's research are included, and a sample dataset for the reader to try some of the statistical procedures mentioned is provided.

en cs.SE
arXiv Open Access 2024
AutoTRIZ: Automating Engineering Innovation with TRIZ and Large Language Models

Shuo Jiang, Weifeng Li, Yuping Qian et al.

Various ideation methods, such as morphological analysis and design-by-analogy, have been developed to aid creative problem-solving and innovation. Among them, the Theory of Inventive Problem Solving (TRIZ) stands out as one of the best-known methods. However, the complexity of TRIZ and its reliance on users' knowledge, experience, and reasoning capabilities limit its practicality. To address this, we introduce AutoTRIZ, an artificial ideation system that integrates Large Language Models (LLMs) to automate and enhance the TRIZ methodology. By leveraging LLMs' vast pre-trained knowledge and advanced reasoning capabilities, AutoTRIZ offers a novel, generative, and interpretable approach to engineering innovation. AutoTRIZ takes a problem statement from the user as its initial input, automatically conduct the TRIZ reasoning process and generates a structured solution report. We demonstrate and evaluate the effectiveness of AutoTRIZ through comparative experiments with textbook cases and a real-world application in the design of a Battery Thermal Management System (BTMS). Moreover, the proposed LLM-based framework holds the potential for extension to automate other knowledge-based ideation methods, such as SCAMPER, Design Heuristics, and Design-by-Analogy, paving the way for a new era of AI-driven innovation tools.

en cs.HC, cs.AI
DOAJ Open Access 2023
Topic Mining and Future Trend Exploration in Digital Economy Research

Changlu Zhang, Qiong Yang, Jian Zhang et al.

This work proposes a new literature topic clustering analysis framework, based on which the topics of digital-economy-related studies are condensed. First, we calculated the word vector of keywords using the FastText model, and then the keywords were merged according to semantic similarity. A hierarchical clustering method based on the Jaccard coefficient was employed to cluster the domain documents. Finally, the information gain method was applied to estimate the high-gain feature words for each category of topics. Based on the above framework, 23 categories of research topics were formed. We divided these topics into layers of digital technology, convergence innovation and digital governance, and we constructed a three-level digital economy research framework. Thereafter, the current hot spots and frontier trends were derived based on the number and growth rate of the literature. Our study revealed that the research on digital technology, which is the basic layer of the digital economy, has waned. The field related to the integration and innovation of digital technology and the real economy was the current research focus, among which the results with respect to “New Business Forms in the Digital Age”, “Circular Economy” and “Gig Economy” were abundant. The problems of the unbalanced development of the digital economy and digital monopoly have strengthened research on digital governance. Furthermore, research on “Regional Digital Economy”, “Chinese Digital Economy” and “Data Management” is in its initial stage and is a potential area of future research.

Information technology
arXiv Open Access 2023
Diversity in Software Engineering Conferences and Journals

Aditya Shankar Narayanan, Dheeraj Vagavolu, Nancy A Day et al.

Diversity with respect to ethnicity and gender has been studied in open-source and industrial settings for software development. Publication avenues such as academic conferences and journals contribute to the growing technology industry. However, there have been very few diversity-related studies conducted in the context of academia. In this paper, we study the ethnic, gender, and geographical diversity of the authors published in Software Engineering conferences and journals. We provide a systematic quantitative analysis of the diversity of publications and organizing and program committees of three top conferences and two top journals in Software Engineering, which indicates the existence of bias and entry barriers towards authors and committee members belonging to certain ethnicities, gender, and/or geographical locations in Software Engineering conferences and journal publications. For our study, we analyse publication (accepted authors) and committee data (Program and Organizing committee/ Journal Editorial Board) from the conferences ICSE, FSE, and ASE and the journals IEEE TSE and ACM TOSEM from 2010 to 2022. The analysis of the data shows that across participants and committee members, there are some communities that are consistently significantly lower in representation, for example, publications from countries in Africa, South America, and Oceania. However, a correlation study between the diversity of the committees and the participants did not yield any conclusive evidence. Furthermore, there is no conclusive evidence that papers with White authors or male authors were more likely to be cited. Finally, we see an improvement in the ethnic diversity of the authors over the years 2010-2022 but not in gender or geographical diversity.

en cs.SE
arXiv Open Access 2023
Extracting Design Knowledge from Optimization Data: Enhancing Engineering Design in Fluid Based Thermal Management Systems

Saeid Bayat, Nastaran Shahmansouri, Satya RT Peddada et al.

As mechanical systems become more complex and technological advances accelerate, the traditional reliance on heritage designs for engineering endeavors is being diminished in its effectiveness. Considering the dynamic nature of the design industry where new challenges are continually emerging, alternative sources of knowledge need to be sought to guide future design efforts. One promising avenue lies in the analysis of design optimization data, which has the potential to offer valuable insights and overcome the limitations of heritage designs. This paper presents a step toward extracting knowledge from optimization data in multi-split fluid-based thermal management systems using different classification machine learning methods, so that designers can use it to guide decisions in future design efforts. This approach offers several advantages over traditional design heritage methods, including applicability in cases where there is no design heritage and the ability to derive optimal designs. We showcase our framework through four case studies with varying levels of complexity. These studies demonstrate its effectiveness in enhancing the design of complex thermal management systems. Our results show that the knowledge extracted from the configuration design optimization data provides a good basis for more general design of complex thermal management systems. It is shown that the objective value of the estimated optimal configuration closely approximates the true optimal configuration with less than 1 percent error, achieved using basic features based on the system heat loads without involving the corresponding optimal open loop control (OLOC) features. This eliminates the need to solve the OLOC problem, leading to reduced computation costs.

en eess.SY
arXiv Open Access 2022
MICOSE4aPS: Industrially Applicable Maturity Metric to Improve Systematic Reuse of Control Software

Birgit Vogel-Heuser, Eva-Maria Neumann, Juliane Fischer

automated Production Systems (aPS) are highly complex, mechatronic systems that usually have to operate reliably for many decades. Standardization and reuse of control software modules is a core prerequisite to achieve the required system quality in increasingly shorter development cycles. However, industrial case studies in the field of aPS show that many aPS companies still struggle with strategically reusing software. This paper proposes a metric-based approach to objectively measure the maturity of industrial IEC 61131-based control software in aPS (MICOSE4aPS) to identify potential weaknesses and quality issues hampering systematic reuse. Module developers in the machine and plant manufacturing industry can directly benefit as the metric calculation is integrated into the software engineering workflow. An in-depth industrial evaluation in a top-ranked machine manufacturing company in food packaging and an expert evaluation with different companies confirmed the benefit to efficiently manage the quality of control software.

arXiv Open Access 2022
Game Engine Comparative Anatomy

Gabriel C. Ullmann, Cristiano Politowski, Yann-Gaël Guéhéneuc et al.

Video game developers use game engines as a tool to manage complex aspects of game development. While engines play a big role in the success of games, to the best of our knowledge, they are often developed in isolation, in a closed-source manner, without architectural discussions, comparison, and collaboration among projects. In this work in progress, we compare the call graphs of two open-source engines: Godot 3.4.4 and Urho3D 1.8. While static analysis tools could provide us with a general picture without precise call graph paths, the use of a profiler such as Callgrind allows us to also view the call order and frequency. These graphs give us insight into the engines' designs. We showed that, by using Callgrind, we can obtain a high-level view of an engine's architecture, which can be used to understand it. In future work, we intend to apply both dynamic and static analysis to other open-source engines to understand architectural patterns and their impact on aspects such as performance and maintenance.

en cs.SE
DOAJ Open Access 2021
Сьома міжнародна науково-практична конференція «Transfer of Innovative Technologies 2021»

Mykhailo Sukach

З 19 по 20 травня у Київському національному університеті будівництва і архітектури проведено VII міжнародну науково-практичну конференцію «Transfer of Innovative Technologies 2021». На ній були представлені креативні ідеї, інноваційні проекти й практичні розробки в галузях будівництва, архітектури, розв’язання нагальних проблем інженерії й проектування об’єктів, захисту навколишнього середовища, сучасні тенденції в інформаційних технологіях та ін. На конференції, яка відбувалась в режимі відеоконференцзв’язку, прийняли участь вітчизняні науковці, викладачі та студенти навчальних закладів, представники виробництв, відомі фахівці країн світу. Усього подано 128 заявок від півтори сотні учасників, у тому числі 15 іноземних з Австралії, Польщі, Словаччини, США, Казахстану, Німеччини, Китаю. Конкурсна комісія визначила кращі роботи в номінаціях: Презентація, Інноваційний проект, Публікація, відзначила Дипломами преможців 2021 року. Учасники отримали Сертифікати, а найактивніші − Подяки за проведену роботу, міжнародні наукові зв’язки та організаційну підтримку форуму. В Збірнику матеріалів конференції (онлайн) та в журналі «Transfer of Innovative Technologies», Vol.4, No.1 опубліковано препринт статті, а презентації учасників – на сайті конференції. Кращі роботи рекомендовано до публікації в міжнародних наукових журналах Transfer of Innovative Technologies, Підводні технології: промислова та цивільна інженерія. Прийнято рішення щодо підготовки й проведення наступного форуму в 2022 році, залучення до інноваційної діяльності креативних учасників та нових установ, подальшої інтеграції у світовий науковий простір. Оргкомітет дякує всім за представлені матеріали та впровадження інноваційних технологій у життя!

Technological innovations. Automation, Mechanical industries
DOAJ Open Access 2021
mHealth Interventions for Treatment Adherence and Outcomes of Care for Cardiometabolic Disease Among Adults Living With HIV: Systematic Review

Odukoya, Oluwakemi Ololade, Ohazurike, Chidumga, Akanbi, Maxwell et al.

BackgroundThe success of antiretroviral therapy has led to an increase in life expectancy and an associated rise in the risk of cardiometabolic diseases (CMDs) among people living with HIV. ObjectiveOur aim was to conduct a systematic review to synthesize the existing literature on the patterns of use and effects of mobile health (mHealth) interventions for improving treatment adherence and outcomes of care for CMD among people living with HIV. MethodsA systematic search of multiple databases, including PubMed-MEDLINE, Embase, CINAHL, Scopus, Web of Science, African Journals online, ClinicalTrials.gov, and the World Health Organization Global Index Medicus of peer-reviewed articles, was conducted with no date or language restrictions. Unpublished reports on mHealth interventions for treatment adherence and outcomes of care for CMD among adults living with HIV were also included in this review. Studies were included if they had at least 1 component that used an mHealth intervention to address treatment adherence or 1 or more of the stated outcomes of care for CMD among people living with HIV. ResultsOur search strategy yielded 1148 unique records. In total, 10 articles met the inclusion criteria and were included in this review. Of the 10 studies, only 4 had published results. The categories of mHealth interventions ranged from short messaging, telephone calls, and wearable devices to smartphone and desktop web-based mobile apps. Across the different categories of interventions, there were no clear patterns in terms of consistency in the use of a particular intervention, as most studies (9/10, 90%) assessed a combination of mHealth interventions. Short messaging and telephone calls were however the most common interventions. Half of the studies (5/10, 50%) reported on outcomes that were indirectly linked to CMD, and none of them provided reliable evidence for evaluating the effectiveness of mHealth interventions for treatment adherence and outcomes of care for CMD among people living with HIV. ConclusionsDue to the limited number of studies and the heterogeneity of interventions and outcome measures in the studies, no definitive conclusions could be drawn on the patterns of use and effects of mHealth interventions for treatment adherence and outcomes of care for CMD among people living with HIV. We therefore recommend that future trials should focus on standardized outcomes for CMD. We also suggest that future studies should consider having a longer follow-up period in order to determine the long-term effects of mHealth interventions on CMD outcomes for people living with HIV. Trial RegistrationPROSPERO International Prospective Register of Systematic Reviews CRD42018086940; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018086940

Information technology, Public aspects of medicine
DOAJ Open Access 2021
Evaluating User Experience of a Mobile Health Application ‘Halodoc’ using User Experience Questionnaire and Usability Testing

Mochammad Aldi Kushendriawan, Harry Budi Santoso, Panca O. Hadi Putra et al.

This paper aims to evaluate the user experience of a mobile health application called Halodoc to keep the user using the application and keep from losing a potential source of revenue for Halodoc. Halodoc is one of the companies that use the internet to provide health services for its users. Halodoc has services such as features for consultation with doctors, online medicine purchases, and hospital appointments. Halodoc’s vision is to simplifying healthcare, but there are still many complaints and negative reviews about Halodoc on Google play store and Apple store about the usability. This paper uses a mixed-method approach using User Experience Questionnaire (UEQ) and Usability Testing. The results of the analysis were used as a reference for making the improvement designs. The results of the UEQ evaluation showed accordingly to the UEQ benchmark already a good level of UX. However, the usability test uncovered some concrete areas for improvement.

Information technology

Halaman 37 dari 557235