Foundation for detecting and applying machine learning design patterns through machine learning

项目来源

日本学术振兴会基金(JSPS)

项目主持人

鷲崎 弘宜

项目受资助机构

早稲田大学

项目编号

23K18470

立项年度

2023

立项时间

未公开

项目级别

国家级

研究期限

未知 / 未知

受资助金额

6370000.00日元

学科

情報科学、情報工学およびその関連分野

学科代码

未公开

基金类别

挑戦的研究(萌芽)

关键词

機械学習工学 ; デザインパターン ; ソフトウェアアーキテクチャ ; ソフトウェア設計 ; システム設計 ;

参与者

吉岡信和

参与机构

未公开

项目标书摘要:Outline of Research at the Start:機械学習システムの高信頼・高効率な開発運用のうえで、過去の開発運用における優れた設計や保守、進化の成果および過程を抽象化した機械学習デザインパターン(以降、MLパターン)の活用が欠かせないが、技術的基盤が得られていない。優れた成果や過程から新たなMLパターンを教師無し機械学習により発見し、発見済みパターンの適用状況を進行中のプロジェクト上で教師あり機械学習により検出し適用を支援する技術基盤を確立する。

  • 排序方式:
  • 1
  • /
  • 1.Landscape and Taxonomy of Prompt Engineering Patterns in Software Engineering

    • Sasaki, Yuya;Washizaki, Hironori;Li, Jialong;Yoshioka, Nobukazu;Ubayashi, Naoyasu;Fukazawa, Yoshiaki
    • 《IT PROFESSIONAL》
    • 2025年
    • 27卷
    • 1期
    • 期刊

    Advancements in large language models (LLMs) have enhanced their ability to handle ambiguous user instructions. However, effective prompt patterns remain crucial for usability and comprehension. This article presents a taxonomy of prompt engineering patterns for software engineering. It is based on a systematic literature review that was conducted in early 2023, when LLMs still faced significant limitations in context length and inference capabilities. Our study explores techniques that enhance the usability and reliability of LLMs, emphasizing the ongoing importance of well-designed prompts in optimizing task performance. Our findings highlight the critical role of prompt patterns in maximizing LLM's potential, even as their capabilities continue to evolve.

    ...
  • 3.AI Engineering Continuum: Concept and Expected Foundation

    • 关键词:
    • Risk management;AI quality;Engineering program;Machine-learning;Meta model;Quality continuum;Quality risks;Risks management;Software engineering for AI and machine learning
    • Washizaki, Hironori;Yoshioka, Nobukazu
    • 《15th International Conference on Information, Intelligence, Systems and Applications, IISA 2024》
    • 2024年
    • July 17, 2024 - July 20, 2024
    • Chania, Greece
    • 会议

    To address the breadth of AI quality risks including security ones, we propose the 'AI Engineering Continuum' as a comprehensive framework consisting of the following five dimensions necessary from the holistic engineering point of view: AI layer continuum, AI process continuum, AI computing continuum, AI automation continuum, and AI quality continuum. The AI engineering continuum is intended to be used to evaluate the adequacy of AI engineering projects and identify weaknesses that should be improved and aligned with the dimensions of the framework. Furthermore, we discuss necessary engineering features and foundations needed to efficiently and effectively raise each dimension of the framework and demonstrate some of their preliminary implementations, including our past achievements. © 2024 IEEE.

    ...
  • 4.AI Security Continuum: Concept and Challenges

    • 关键词:
    • Risk management;Software engineering;AI security;Computing environments;Conceptual frameworks;Machine-learning;Meta model;Security measure;Security risk managements;Security risks;Software engineering for AI and machine learning;Technical activities
    • Washizaki, Hironori;Yoshioka, Nobukazu
    • 《3rd International Conference on AI Engineering, CAIN 2024, co-located with the 46th International Conference on Software Engineering, ICSE 2024》
    • 2024年
    • April 14, 2024 - April 15, 2024
    • Lisbon, Portugal
    • 会议

    We propose a conceptual framework, named "AI Security Continuum,"consisting of dimensions to deal with challenges of the breadth of the AI security risk sustainably and systematically under the emerging context of the computing continuum as well as continuous engineering. The dimensions identified are the continuum in the AI computing environment, the continuum in technical activities for AI, the continuum in layers in the overall architecture, including AI, the level of AI automation, and the level of AI security measures. We also prospect an engineering foundation that can efficiently and effectively raise each dimension. © 2024 Copyright held by the owner/author(s).

    ...
  • 5.A Machine Learning Based Approach to Detect Machine Learning Design Patterns

    • 关键词:
    • Abstracting;Codes (symbols);High level languages;Learning algorithms;Pattern recognition;Python;Trees (mathematics);Automated pattern recognition;Classification models;Code classification;Code classification model;Design Patterns;Design problems;Learning designs;Learning-based approach;Machine learning design pattern;Machine-learning
    • Pan, Weitao;Washizaki, Hironori;Yoshioka, Nobukazu;Fukazawa, Yoshiaki;Khomh, Foutse;Gueheneuc, Yann-Gael
    • 《30th Asia-Pacific Software Engineering Conference, APSEC 2023》
    • 2023年
    • December 4, 2023 - December 7, 2023
    • Seoul, Korea, Republic of
    • 会议

    As machine learning expands to various domains, the demand for reusable solutions to similar problems increases. Machine learning design patterns are reusable solutions to design problems of machine learning applications. They can significantly enhance programmers' productivity in programming that requires machine learning algorithms. Given the critical role of machine learning design patterns, the automated detection of them becomes equally vital. However, identifying design patterns can be time-consuming and error-prone. We propose an approach to detect their occurrences in Python files. Our approach uses an Abstract Syntax Tree (AST) of Python files to build a corpus of data and train a refined Text-CNN model to automatically identify machine learning design patterns. We empirically validate our approach by conducting an exploratory study to detect four common machine learning design patterns: Embedding, Multilabel, Feature Cross, and Hashed Feature. We manually label 450 Python code files containing these design patterns from repositories of projects in GitHub. Our approach achieves accuracy values ranging from 80 % to 92% for each of the four patterns. © 2023 IEEE.

    ...
  • 排序方式:
  • 1
  • /