5ã€ã®ãã§ãŒãºã§åéå šäœãçè§£ãã
ããã³ãããšã³ãžãã¢ãªã³ã°ã¯ã2020幎é ã®GPT-3ããããéå ¬åŒãªè©Šè¡é¯èª€ã«ããããã¹ãæäœããã2026幎ãŸã§ã«ååã®ä»ãããã¯ããã¯ã»ãã¬ãŒã ã¯ãŒã¯ã»ããŒã«ãæã€äœç³»çãªåéãžãšé²åããŸããã ãã®æ©ã¿ã¯5ã€ã®ãã§ãŒãºã«ããããŸãïŒåæã®ãã¥ãŒã·ã§ããå®éšã»å€§è¡ã®èªèã«ã¹ãã«ããããããChatGPTã®ç¬éã»æ§é åãããæšè«ãã¯ããã¯ã®çºå±ã»èªåããã³ããæé©åã®å°é ã»ãããŠçŸåšã®ã³ã³ããã¹ããã¶ã€ã³ãžã®ç§»è¡ã
ãã®åéã¯åäžã®è«æãäŒæ¥ããçãŸããã®ã§ã¯ãããŸãããç ç©¶ïŒãã¥ãŒã·ã§ããåŠç¿ã»æèã®é£éæšè«ã»RAGïŒãšãããã³ããã³ã¬ã¯ã·ã§ã³ããªã³ã©ã€ã³ã§å ±æããå®è·µè ã³ãã¥ããã£ãšãåªããããã³ããã£ã³ã°ãå³åº§ã«å ±ããããã®ã«ãã匷åãªã¢ãã«ã®çªç¶ã®äžè¬å ¬éãšã®éãªãããæé·ããŸããã2026幎çŸåšãããã³ãããšã³ãžãã¢ãªã³ã°ã¯ãã¯ãããããªããªãã¯ã§ã¯ãããŸãã â AIã·ã¹ãã ãæ±ã誰ããæã€ã¹ãåºæ¬ã¹ãã«ã§ãã
ããã5ã€ã®ãã§ãŒãºã¯ãããã³ãããšã³ãžãã¢ãªã³ã°ãã©ã®ããã«çºå±ããããçè§£ããããã®åºç€ã§ããçŸåšã®ããã³ãããšã³ãžãã¢ãªã³ã°ã®å®å šãªå®çŸ©ã«ã€ããŠã¯ãWhat Is Prompt Engineering?ãåç §ããŠãã ããã
éèŠãªãã€ã³ã
- 2019ã2020幎ïŒGPT-2ãšåæãã©ã³ã¹ãã©ãŒã㌠â ããã³ããã¯å ¥åã§ãã£ãŠãåéã§ã¯ãªãã£ã
- 2020幎ïŒGPT-3ãšBrown et al.ããã¥ãŒã·ã§ããããã³ããã£ã³ã°ããã©ãã€ã ã·ãããšããŠå°å ¥
- 2022å¹ŽïŒæèã®é£éïŒChain-of-ThoughtïŒæšè«ããã³ãããããã³ããã£ã³ã°ãæ§é åãããã¹ãã«ãžãšå€ãã
- 2022幎åŸåïŒChatGPTãããã³ãããšã³ãžãã¢ãªã³ã°ãäž»æµã®èªèãšæ±äººç¥šã«ããããã
- 2023幎ïŒGPT-4ã»ãã«ãã¢ãŒãã«ããã³ããã£ã³ã°ã»ãã¬ãŒã ã¯ãŒã¯ããã¹ããã©ã¯ãã£ã¹ãäœç³»åãã
- 2024ã2026幎ïŒã³ã³ããã¹ããã¶ã€ã³ã»èªåããã³ããã£ã³ã°ã»ãªãŒãã³ãœãŒã¹LLMããã®åéãåå®çŸ©ãã
ããã³ãããšã³ãžãã¢ãªã³ã°ãšããåç§°ãçãŸããåïŒ2020幎以åïŒ
ãããã³ãããšã³ãžãã¢ãªã³ã°ããšããçšèªãååšããåãããç ç©¶è ãã¡ã¯ããè¯ãåºåãåŒãåºãããã«ã¢ãã«ãžã®å ¥åãæäœããŠããŸãã â ãã ããããããåŒãã§ããªãã£ãã ãã§ããGPT-2ïŒ2019幎ãOpenAIïŒãBERTïŒ2018幎ãGoogleïŒãªã©ã®åæãã©ã³ã¹ãã©ãŒããŒã¢ãã«ã¯æ³šææ·±ãéžã°ããå ¥åããã¹ããéããŠäœ¿ãããŠããŸãããããã®å®è·µã¯ããŒã¿ååŠçã®äžéšãšããŠæ±ãããŠãããç¬èªã®ã¹ãã«ãšã¯èŠãªãããŠããŸããã§ããã
2019幎2æã«ãªãªãŒã¹ãããGPT-2ã¯15åãã©ã¡ãŒã¿ãŒã®ã¢ãã«ã§ãé©ãã»ã©æŽåæ§ã®ããæ¹æ³ã§ããã¹ããè£å®ã§ããŸãããç ç©¶è ãšåæã®å®è·µè ã¯ãå ¥åã®ãã¬ãŒãºãè£å®ã®å質ãåçã«å€ããããšã«æ°ã¥ããŸãããããã®èгå¯ãããããã¬ãŒã ã¯ãŒã¯ã»çšèªã»ã³ãã¥ããã£ã¯ãŸã ååšããŠããŸããã§ãããããã³ããã¯å ¥åã§ãã£ãŠããšã³ãžãã¢ãªã³ã°äžã®ææç©ã§ã¯ãããŸããã§ããã
2020幎ïŒGPT-3ãšãã¥ãŒã·ã§ããã®é©æ°
ããã³ãããšã³ãžãã¢ãªã³ã°ã®çŸä»£å²ã¯å®è³ªçã«GPT-3ããå§ãŸããŸãã 2020幎5æãOpenAIã¯1750åãã©ã¡ãŒã¿ãŒã®ã¢ãã«ã§ããGPT-3ããBrown et al.ã«ããç»æçãªè«æãLanguage Models are Few-Shot LearnersãBrown et al., 2020 â Language Models are Few-Shot Learners ãšãšãã«ãªãªãŒã¹ããŸããããã®è«æã¯ãã¢ãã«ãžã®éã¿ã®æŽæ°ãªãã«ãæãŸããã¿ã¹ã¯ã®ããã€ãã®äŸãããã³ããã«çŽæ¥å«ããã ãã§ãäžæµã¿ã¹ã¯ã®ããã©ãŒãã³ã¹ãåçã«åäžããããšãå®èšŒããŸããã
ãããããã³ãããšã³ãžãã¢ãªã³ã°ãšããåéã®çš®ã§ãããç ç©¶è ãšéçºè ã¯ãããã³ããã®æžãæ¹ãå€ããã ãã§ãåãã¢ãã«ã翻蚳è ã»èŠçŽè ã»ã³ãŒããžã§ãã¬ãŒã¿ãŒã»è³ªåå¿çã·ã¹ãã ã«å€èº«ã§ããããšãèªèããŸãããã¢ãã«ã®åãã¬ãŒãã³ã°ã¯äžèŠã§ãã â ããè¯ãããã³ãããå¿ èŠãªã ãã§ããããã®æŽå¯ã¯ããã³ããã®æå³ãåæ§ç¯ããŸããïŒåãªãå ¥åã§ã¯ãªããèšèšäžã®ææç©ãšããŠã
ãã©ãŠã³ãã¯ãfew-shotã®æ§èœãã¢ãã«ãµã€ãºãšäžè²«ããŠæ¡åŒµããããšãå ±åããŸããã1,750åãã©ã¡ãŒã¿ã®GPT-3ã¯ããã¹ããããã¹ãŠã®ãã³ãããŒã¯ã§å°åããªã¢ã³ããå€§å¹ ã«äžåããã¹ã±ãŒã«ãšããã³ããããŒã¹ã®åŠç¿ãçŽæ¥çµã³ã€ããŠããããšã確ç«ããŸãããããã«ãããããã³ããã®å質ã¯ç ç©¶è ã ãã§ãªãå®åå®¶ãçŽæ¥å¶åŸ¡ã§ãã倿°ãšãªããŸããã
GPT-3ãæåã«ãããã¯ããã¯ã®å®è·µã¬ã€ãã«ã€ããŠã¯ Zero-Shot vs. Few-Shot: Which Approach Gets Better Results? ãåç §ããŠãã ããã
ããã³ããé²åïŒ2020幎ãã2026幎ãž
åæã®GPT-3ããã³ããããçŸä»£çãªã³ã³ããã¹ãèšèšãããã·ã¹ãã ãžã®é²åã¯ãçŽæ¥æ¯èŒã«ãã£ãŠèŠããŸãã2020幎ãããã³ããã¯æå°éã§ãã â äŸãšã¿ã¹ã¯èšè¿°ã ãã2026幎ãŸã§ã«ãããã³ããã¯ã³ã³ããã¹ããŠã£ã³ããŠããªãŒã±ã¹ãã¬ãŒã·ã§ã³ããããŒã«çžäºäœçšã管çãããã«ãã¹ãããæšè«ã¯ãŒã¯ãããŒãå®çŸ©ããã·ã¹ãã ã«ãªããŸããã
2020幎ã®ããã³ããã¯å€§äœãããªæãã ã£ããããããŸããïŒãããããã©ã³ã¹èªã«ç¿»èš³ããŠãã ããïŒããã«ã¡ã¯ããå æ°ã§ããïŒã â æå°éã®æ§é ãæã€çŽæ¥çãªæç€ºã2026幎ã®ããã³ããã¯ã·ã¹ãã æç€ºã圹å²å®çŸ©ãåºå圢åŒãæ€çŽ¢ã³ã³ããã¹ããããŒã«å¯çšæ§ãæšè«å¶çŽãå«ããŸã â ãã°ãã°æ°çŸããæ°åããŒã¯ã³ã«åã³ãŸãããã®ã·ããã¯ãã倧ããªã¢ãã«ãšãã倧ããªã³ã³ããã¹ããŠã£ã³ããŠã ãã§ãªããããã³ããã®èšè𿹿³ã®æ ¹æ¬çãªå€åãåæ ããŠããŸãïŒããã¹ãè£å®ãžã®å ¥åã§ã¯ãªããã·ã¹ãã ãžã®ã€ã³ã¿ãŒãã§ãŒã¹ãšããŠã
2021ã2022幎åé ïŒããã³ããã®ããªãã¯ããèªããããã¹ãã«ãž
2021幎ãã2022幎åé ã«ãããŠãããã³ããã®äœæã¯ç ç©¶è«æããå®è·µè ã³ãã¥ããã£ãžãšç§»è¡ããŸãããã³ãŒãã£ã³ã°æ¯æŽã»èŠçŽã»ã¯ãªãšã€ãã£ãã©ã€ãã£ã³ã°ã«å¹æçãªããã³ãããå ±æãããawesome-promptsãã¹ã¿ã€ã«ã®ãã¥ã¬ãŒã·ã§ã³ãããããã³ããã³ã¬ã¯ã·ã§ã³ã®GitHubãªããžããªãç»å ŽããŸãããTwitterãRedditã§å ±æãããããã³ããã³ã¬ã¯ã·ã§ã³ã¯ã³ãã¥ããã£ã®è³ç£ãšãªããŸãããPrompt Engineering GuideïŒpromptingguide.aiïŒPrompt Engineering Guide â promptingguide.ai ã¯ãã¯ããã¯ãäœç³»çã«ã«ã¿ãã°åããæåã®å°çšãªãã¡ã¬ã³ã¹ã®äžã€ã«ãªããŸããã
ãããã³ãããšã³ãžãã¢ãªã³ã°ããšããçšèªã¯ãã®æéãéããŠãç ç©¶è«æã»ããã°æçš¿ã»æ±äººç¥šã«ãŸããŸãé »ç¹ã«ç»å Žããããã«ãªããŸãããOpenAIã®InstructGPTè«æïŒOuyang et al.ã2022幎ïŒã¯RLHFãã¥ãŒãã³ã°ãããã¢ãã«ãå°å ¥ããèªç¶èšèªã®æç€ºã«å¯ŸããŠã¯ããã«ä¿¡é Œæ§é«ãåå¿ããããã«ãªããŸãã â ããã³ããã®å質ãããã«éèŠãªãã®ã«ããŸããã2022幎åã°ãŸã§ã«ããããåãªãç ç©¶è ã®å¥œå¥å¿ã§ã¯ãªãã移転å¯èœãªã¹ãã«ã§ããããšãæããã«ãªããŸããã
2022å¹ŽïŒæèã®é£éïŒChain-of-ThoughtïŒãšæšè«ããã³ãã
2022å¹Žã®æèã®é£éïŒCoTïŒããã³ããã£ã³ã°ã®å°å ¥ã¯ããã®åéã®çãæŽå²ã«ãããæãéèŠãªæè¡ççºå±ã§ããã Wei et al.ïŒGoogle BrainïŒããChain-of-Thought Prompting Elicits Reasoning in Large Language Modelsããçºè¡šããåçããåã«ã¹ããããã€ã¹ãããã§æšè«ããããã¢ãã«ã«æ±ããããšã§ãç®è¡ã»åžžèçæšè«ã»èšå·çæšè«ã¿ã¹ã¯ã®ããã©ãŒãã³ã¹ãåçã«åäžããããšãå®èšŒããŸãããGSM8Kã®å°åŠæ ¡æ°åŠãã³ãããŒã¯ã§ã¯ãchain-of-thoughtããã³ããã£ã³ã°ã«ããPaLMã®ç²ŸåºŠã17.9%ãã58%ã«åäžããŸãããããã¯è¿œå ã®ã¢ãã«ãã¬ãŒãã³ã°ãªãã«ãããã³ããæ§é ãå€ããã ãã§éæãããææã§ãã ãã®æå³ã¯æ·±é ã§ããïŒããã³ããã®æ§é ãç°ãªãæšè«è¡åãæŽ»æ§åã§ãã â åã«ç°ãªãäºå®ã ãã§ãªãã
é¢é£ãããã¯ããã¯ãçŽ æ©ãç¶ããŸãããZhou et al.ã¯æå°ããæå€§ãžã®ããã³ããã£ã³ã°ãå°å ¥ããè€éãªåé¡ãé çªã«è§£æ±ºãããäžé£ã®ããåçŽãªãµãåé¡ã«åè§£ããŸããããããã®ã¢ãããŒãã«ãããããã³ãããšã³ãžãã¢ãªã³ã°ã¯ãã©ãŒãããæŒç¿ããããã®ãããªæšè«æ¹æ³ã§æç€ºçã«ãã¬ãŒãã³ã°ãããŠããªãã¢ãã«ããæ§é åãããæšè«ãåŒãåºãããŒã«ãžãšå€ãããŸãããããã³ããã£ã³ã°ã¯èªç¥ã®ããã®è¶³å Žã«ãªããŸããã
å®å šãªãã¯ããã¯ã¬ã€ãã«ã€ããŠã¯ Chain-of-Thought Prompting: Make AI Show Its Reasoning ãš Prompt Chaining: How to Break Big Tasks Into Winning Steps ãåç §ããŠãã ããã
2022幎åŸåã2023幎ïŒChatGPTã®ç¬éãšããã³ãããšã³ãžãã¢ãšããè©æžã
2022幎11æ30æ¥ã®ChatGPTãªãªãŒã¹ã¯ãããã³ãããšã³ãžãã¢ãªã³ã°ã®å ¬çãªãããã£ãŒã«ãäžå€ã«ããŠå€ããŸããã ChatGPTã¯ãµãŒãã¹éå§ãã5æ¥ä»¥å ã«100äžãŠãŒã¶ãŒãéæããŸããââ2022幎12æã«OpenAI CEOã®ãµã ã»ã¢ã«ããã³ãTwitterã§ç¢ºèªââãããŠãã€ã¿ãŒãåŒçšããUBSã®åæã«ãããšã2023幎1æã«ã¯æéã¢ã¯ãã£ããŠãŒã¶ãŒ1å人ã«éããŸããã æ°æ¥ã®ãã¡ã«ãäœçŸäžãã®äººã ãããã³ããã詊ãããªã¯ãšã¹ãã®ãã¬ãŒãºã®ä»æ¹ã«ãã£ãŠçµæã倧ããç°ãªãããšãçºèŠããŸããããã¯ãããžãŒã¡ãã£ã¢ã¯ãããã³ãããšã³ãžãã¢ãªã³ã°ããç¿åŸãã䟡å€ã®ããã¹ãã«ãšããŠåãäžããŸããããªãã¯ã¹ãã©ãŒãè±èªèŸå žã¯2023幎ã«AIã«é¢é£ããåè©ãšããŠãpromptãã远å ãããã®åèªèªäœãè€æ°ã®ã©ã³ãã³ã°ã§ä»å¹Žã®èšèã®åè£ã«ãªããŸããã
2023幎åé ãŸã§ã«ããããã³ãããšã³ãžãã¢ãã¯åºãåŒçšãããæ±äººç¥šã«ãããšAnthropicãå«ãäŒæ¥ã§17.5äžã33.5äžãã«ã®çµŠäžã§æ±äººã¿ã€ãã«ãšããŠç»å ŽããŸããããã®åœ¹è·ã¯å€§ããªã¡ãã£ã¢ã®æ³šç®ãéããŸãã â Bloombergã»The Guardianã»The Atlanticããã¹ãŠãããã³ãããšã³ãžãã¢ãªã³ã°ãçã®ãã£ãªã¢ãã©ãããåãäžããŸãããåœæã®ã³ã³ã»ã³ãµã¹ïŒããã¯ç§»è¡æçãªåœ¹å²ã§ããããã¥ãŒãã³ã³ã³ãã¥ãŒã¿ãŒã€ã³ã¿ãŒãã§ãŒã¹èšèšã»å°éç¥èã»å質ä¿èšŒã®äžéšã ãšã
ãããã³ãããšã³ãžãã¢ãªã³ã°ããšãããã¬ãŒãºã®æ®ååã¯ãæ§ã ãªå®è·µè ãã³ã¡ã³ããŒã¿ãŒã«èµ·å ãããšãããããšããããŸããSalesforceã®å ããŒããµã€ãšã³ãã£ã¹ãã§ããRichard Socherã¯ããã®èããæ©æã«åºããããšã«è²¢ç®ãããšãã解説ã«èšåãããŠããŸããWikipediaã®ããã³ãããšã³ãžãã¢ãªã³ã°ã®èšäº Prompt Engineering â Wikipedia ã¯ãçšèªã®èµ·æºã«ã€ããŠã®ç«¶åãã䞻匵ããã©ã³ã¹ããæŠèª¬ããŠããŸãã
2023幎ïŒGPT-4ã»ãã«ãã¢ãŒãã«ããã³ããã£ã³ã°ã»ãã¬ãŒã ã¯ãŒã¯
2023幎3æã®GPT-4ã®ãªãªãŒã¹ã¯ãããã³ãããšã³ãžãã¢ãªã³ã°ãåæã«2ã€ã®æ¹åã«æ¡åŒµããŸããïŒãã倧ããªã³ã³ããã¹ããŠã£ã³ããŠïŒåŸã®ããŒãžã§ã³ã§ã¯æå€§128KããŒã¯ã³ïŒãšãã«ãã¢ãŒãã«å ¥åãå®è·µè ã¯ããã¹ããšãšãã«ããã³ããã«ç»åãå«ããããšãã§ããããã«ãªããããã³ãããšã³ãžãã¢ãªã³ã°ãããžã¥ã¢ã«ã¿ã¹ã¯ â ç»åã®èª¬æã»å³ã®æ¯èŒã»ã°ã©ããžã®æ³šéä»ã â ã«éãããŸãããGoogleããã®Geminiã®åæã¢ãã«ãšAnthropicããã®ãã«ãã¢ãŒãã«ClaudeããŒãžã§ã³ãæ°ã¶æä»¥å ã«ç¶ããŸããã
å幎ãããã³ãããšã³ãžãã¢ãªã³ã°ã®ãã¹ããã©ã¯ãã£ã¹ã®äœç³»åãèŠãããŸãããOpenAIã¯å ¬åŒã®ããã³ãããšã³ãžãã¢ãªã³ã°ã¬ã€ã OpenAI â Best Practices for Prompt Engineering ãå ¬éããŸãããGoogle Cloudã¯ç¬èªã®ããã³ãããšã³ãžãã¢ãªã³ã°ããã¥ã¡ã³ã Google Cloud â Prompt Engineering for AI Guide ããªãªãŒã¹ããŸãããç¬ç«ããèè ããã¬ãŒã ã¯ãŒã¯ â CRAFTã»CO-STARã»SPECSã»RISENã»TRACE â ãäœç³»åããå®è·µè ã«ããã³ããæ§é åã®åå©çšå¯èœãªãã³ãã¬ãŒããæäŸãã詊è¡é¯èª€ãžã®äŸåãæžãããŸããã
ãããã®ãã¬ãŒã ã¯ãŒã¯ã¯ãããã³ãããšã³ãžãã¢ãªã³ã°ãå人çãªã¹ãã«ããæããããã»å ±æå¯èœãªå®è·µãžãšæçããããšã衚ããŠããŸããããã¬ãŒã ã¯ãŒã¯éã®éžæã¬ã€ãã«ã€ããŠã¯ Which Prompt Framework Should You Use? ãããã«ãã¢ãŒãã«ã®åŽé¢ã«ã€ããŠã¯ Beyond Text: How to Prompt with Images ãåç §ããŠãã ããã
PromptQuorum ãã«ãã¢ãã«ãã¹ãïŒãã¬ãŒã ã¯ãŒã¯ã®ã¢ãã«éã§ã®å¹æ
PromptQuorumã¯åãã¿ã¹ã¯ â CO-STARãã¬ãŒã ã¯ãŒã¯ã§æ§é åããã â ãGPT-4oãClaude 4.6 SonnetãGemini 1.5 Proã«éä¿¡ããŸããã3ã€ã®ã¢ãã«å šãŠãæåã®è©Šè¡ã§ãã©ãŒãããæºæ ãé·ãæºæ ã®åçãçæããŸããããã¬ãŒã ã¯ãŒã¯ãªãã®åãã¿ã¹ã¯ã¯ãã¢ãã«éã§å¹³å2ïœ3åã®ä¿®æ£ã©ãŠã³ããå¿ èŠã§ãããæçšãªåºåã«å°éããããã«ã
PromptQuorumã¯ããã®æéã«æ£åŒåããã9ã€ã®ãã¬ãŒã ã¯ãŒã¯ â CO-STARãCRAFTãRISENãSPECSãTRACEããã®ä»4〠â ãåäžã®ã€ã³ã¿ãŒãã§ãŒã¹ã«çµ±åããå®è·µè ãæ¯åãŒãããæ§ç¯ããããšãªãåæ§é ãé©çšã§ããããã«ããŠããŸãã
2023ã2024幎ïŒèªåããã³ãããšã³ãžãã¢ãªã³ã°ãšRAG
2023å¹Žã®æ³šç®ãã¹ãçºå±ã¯ãLLMã人éãšåããããããŸãããã³ãããæé©åã§ããããšã瀺ããç ç©¶ã§ãããZhou et al.ããLarge Language Models Are Human-Level Prompt EngineersãïŒAPEïŒãçºè¡šããããã³ããåè£ãçæã»è©äŸ¡ããã¿ã¹ã¯ãäžããããLLMããã³ãããŒã¯ã¿ã¹ã¯ã§äººéãæžããããã³ããã«å¹æµãŸãã¯ãããäžåããããšãå®èšŒããŸãããStanfordã®DSPyãã¬ãŒã ã¯ãŒã¯ïŒ2023幎ïŒã¯ãããããã«é²ããéçºè ãããã³ãããéæãã¹ãããšã説æãããšãã·ã¹ãã ãèªåçã«èšãåããæé©åã§ããããã«ããŸããã
åæã«ãRAGïŒæ€çŽ¢æ¡åŒµçæïŒ â å ã 2020幎ã«Metaã®Lewis et al.ã«ãã£ãŠå°å ¥ããã â ãæ¬çªAIã·ã¹ãã ã®äžå¿çãªãã¿ãŒã³ã«ãªããŸãããRAGã¯ååŸããããã¥ã¡ã³ããããã³ããã®ã³ã³ããã¹ãã«çŽæ¥æ³šå ¥ããããã³ããã«å¿ èŠãªäºå®ããã¹ãŠå«ããããšãèŠæ±ããã®ã§ã¯ãªããå®éã®ææ°ã®ãœãŒã¹ã«ã¢ãã«ã®åºåãæ ¹æ ä»ããŸãããããã«ããããã³ãããšã³ãžãã¢ãªã³ã°ã®éç¹ããã¢ãã«ã«ãããç¥ãããã«ã¯ã©ãããã°ãããïŒããããã¢ãã«ããããæ£ãã䜿ãããã«ã³ã³ããã¹ããã©ãæ§é åãããïŒããžãšã·ããããŸããã
ãã®æéã®äž»èŠãªãã¯ããã¯ã®è§£èª¬ã«ã€ããŠã¯ RAG Explained: How to Ground AI Answers in Real Data ãš Self-Consistency Prompting: Let the AI Check Its Own Work ãåç §ããŠãã ããã
2024ã2025幎ïŒããã³ãããšã³ãžãã¢ãªã³ã°ããã³ã³ããã¹ããã¶ã€ã³ãž
2024幎ãŸã§ã«ããããè¯ãããã³ãããæžãããšããã·ã³ãã«ãªã¢ã€ãã¢ã眮ãæããæ°ãããã¬ãŒãã³ã°ãçŸãå§ããŸãããå®è·µè ãšç ç©¶è ã¯ã³ã³ããã¹ããšã³ãžãã¢ãªã³ã°ãèšåãå§ããŸãã â ãã«ã³ã³ããã¹ããŠã£ã³ããŠã«äœãå ¥ããã調æŽããå®è·µïŒã·ã¹ãã ããã³ããã»ååŸããããã¥ã¡ã³ãã»ããŒã«åºåã»äŒè©±å±¥æŽã»ãŠãŒã¶ãŒå ¥åãããã¹ãŠã¢ãã«ã®åäœãèªå°ããããã«æå³çã«çµã¿åããããŸããããã³ããã¯ãã¯ãã¹ã¿ã³ãã¢ãã³ã®ææç©ã§ã¯ãªããèšèšãããã³ã³ããã¹ãã®äžå±€ã§ããã
ããã€ãã®çºå±ããã®ã·ãããå éããŸãããMetaã®ã¢ãã«ïŒ2024幎ã®Llama 3ã¯ã©ã¹ïŒã¯ãã©ã€ããŒãå±éã®ããã®æèœãªãªãŒãã³ãœãŒã¹LLMãå©çšå¯èœã«ããäžéšã®ããã³ãããšã³ãžãã¢ãªã³ã°ãã¯ã©ãŠãAPIããããŒã«ã«ã€ã³ãã©ãžãšã·ããããŸãããã³ã³ããã¹ããŠã£ã³ããŠã¯100äžããŒã¯ã³ä»¥äžïŒGemini 1.5 ProïŒã«æé·ããã³ãŒãããŒã¹å šäœã»æžç±ã»ããã¥ã¡ã³ãã³ã¬ã¯ã·ã§ã³å šäœãåäžã®ããã³ããã«æ³šå ¥ããããšãå®çšçã«ãªããŸãããLangChainãAutoGenã®ãããªãã«ããšãŒãžã§ã³ããã¬ãŒã ã¯ãŒã¯ã¯ããã³ããã£ã³ã°ããªãŒã±ã¹ãã¬ãŒã·ã§ã³ã«å€ããŸãã â äžã€ã®ããã³ãããå¥ã®ã¢ãã«ãããªã¬ãŒãããããããŒã«ãããªã¬ãŒãããããæ¬¡ã®ããã³ããã«ã³ã³ããã¹ããè¿ããŸãã
ãã®ç§»è¡ãžã®å€éšçãªèŠç¹ã«ã€ããŠã¯ Prompt Engineering from 2020 to 2025 â AI Supremacy ãš The Evolution of Prompt Engineering to Context Design â 2026 ãåç §ããŠãã ããã
2026幎以éïŒã³ã¢ã»ãªãã©ã·ãŒãšããŠã®ããã³ãããšã³ãžãã¢ãªã³ã°
2026幎çŸåšãç ç©¶ãšã³ã¡ã³ã¿ãªãŒã¯ããã³ãããšã³ãžãã¢ãªã³ã°ãããããªè·çš®ãšããŠã§ã¯ãªããAIããŒã«ã䜿ããã¬ããžã¯ãŒã«ãŒã®ããã®åºæ¬çãªãªãã©ã·ãŒã¹ãã«ãšããŠãŸããŸã説æããããã«ãªã£ãŠããŸãããPrompt Engineering as a New 21st Century SkillãPrompt engineering as a new 21st century skill â Frontiers ã®ãããªåŠè¡è«æã¯ãæ§é åãããããã³ããã£ã³ã°ãèªã¿ã»æžãã»èšç®ãšäžŠãã§ãçæAIã·ã¹ãã ãæ±ãããã®åºæ¬çãªèœåãšããŠäœçœ®ã¥ããŠããŸãã
ãã®åœ¹å²ã¯2ã€ã®ç°ãªããã©ãã¯ã«åãããŸããã1ã€ç®ã¯ã·ã¹ãã ãšã³ã³ããã¹ããã¶ã€ã³ â ããã³ãããååŸã»ãšãŒãžã§ã³ãã»è©äŸ¡ãã€ãã©ã€ã³ãå«ããã倧ããªã¢ãŒããã¯ãã£ã®äžéšã圢æããæ¬çªAIã·ã¹ãã ã®ãšã³ãžãã¢ãªã³ã°ã2ã€ç®ã¯æ¥åžžçãªäœ¿çš â åºç€ãšãªãã¢ãŒããã¯ãã£ãç¥ããªããŠãæçšãªåºåãçæããæç¢ºã§æ§é åãããããã³ãããæžãèœåãäž¡æ¹ã®ãã©ãã¯ãåãã³ã¢ååããæ©æµãåããŸãïŒæç¢ºãªã¿ã¹ã¯æå®ã»é©åãªã³ã³ããã¹ãã»å¶çŽã»åºå圢åŒã
ãã髿§èœãªã¢ãã«ãšèªååããŒã«ã«ããããããå€ãã£ãŠããªãã®ã¯ãæ ¹æ¬ååã§ãïŒå ¥åãæç¢ºã§æ§é åãããŠããã»ã©ãåºåã¯ããä¿¡é Œæ§ãé«ãæçšã«ãªããŸãããã¯ããã¯ã»çšèªã»ããŒã«ã¯æçããŸããããGPT-3æä»£ã®ã³ã¢ãªæŽå¯ã¯2026幎ã§ãçå®ã§ããç¶ããŠããŸãã
ã¿ã€ã ã©ã€ã³ïŒããã³ãããšã³ãžãã¢ãªã³ã°ã®äž»èŠãªãã€ã«ã¹ããŒã³
以äžã®è¡šã¯2018幎ãã2026幎ã®äž»èŠãªãã€ã«ã¹ããŒã³ããŸãšãããã®ã§ã â ããã³ãããšã³ãžãã¢ãªã³ã°ãçŸåšã®åœ¢ã«é²åããåºæ¥äºã»è«æã»ã¢ãã«ãªãªãŒã¹ã
| 幎 | ãã€ã«ã¹ããŒã³ | éèŠãªçç± |
|---|---|---|
| 2018ã2019幎 | BERTïŒGoogleïŒãšGPT-2ïŒOpenAIïŒã®ãªãªãŒã¹ | ãã©ã³ã¹ãã©ãŒããŒã¢ãã«ãå ¥åã®ãã¬ãŒãºã«ãã£ãŠèªå°ã§ããããšãå®èšŒ â ãã ããŸã æ£åŒãªåéã¯ãªãã£ã |
| 2020幎 | GPT-3ãšBrown et al.ãLanguage Models are Few-Shot Learnersã | ãã¥ãŒã·ã§ããããã³ããã£ã³ã°ããã©ãã€ã ãšããŠç¢ºç«ïŒããã³ãããæžãçŽãããšãåãã¬ãŒãã³ã°ãªãã«ã¢ãã«ã®åäœãå€ãã |
| 2022幎ïŒ1æïŒ | InstructGPT / RLHFïŒOuyang et al.ãOpenAIïŒ | æç€ºã«åŸãããã«ãã¬ãŒãã³ã°ãããã¢ãã« â ããã³ããã®å質ãã¯ããã«éèŠã«ãªã£ã |
| 2022幎ïŒ5æïŒ | æèã®é£éããã³ããã£ã³ã°ïŒWei et al.ãGoogle BrainïŒ | ããã³ããã®æ§é ãã¹ããããã€ã¹ãããã®æšè«ãåŒãåºããããšã蚌æ â ããã³ããã£ã³ã°ãèªç¥ã®è¶³å Žã«å€ãã |
| 2022幎ïŒ11æïŒ | ChatGPTã®ããŒã³ã | ããã³ãããšã³ãžãã¢ãªã³ã°ãäž»æµã®èªèã«ãããããïŒäœçŸäžãã®äººã ãäžå€ã«ããŠå®éšãå§ãã |
| 2023幎ïŒQ1ïŒ | ãããã³ãããšã³ãžãã¢ããšããæ±äººã¿ã€ãã«ã30äžãã«ä»¥äžã®çµŠäžã§æ²èŒïŒOEDãpromptãåè©ãšããŠè¿œå | ããã³ãããšã³ãžãã¢ãªã³ã°ãèªããããè·æ¥ãšååã®ä»ããã¹ãã«ãšããŠå®çŸ©ãã |
| 2023幎ïŒ3æïŒ | GPT-4ãªãªãŒã¹ïŒç»åã䜿ã£ããã«ãã¢ãŒãã«ããã³ããã£ã³ã° | ããã³ãããšã³ãžãã¢ãªã³ã°ãããã¹ããè¶ ããããžã¥ã¢ã«å ¥åãšå€§ããªã³ã³ããã¹ããŠã£ã³ããŠã«æ¡åŒµãã |
| 2023幎 | ãã¬ãŒã ã¯ãŒã¯ã®äœç³»åïŒCRAFTã»CO-STARã»SPECSã»RISENïŒOpenAIãšGoogleããã®å ¬åŒã¬ã€ã | ããã³ãããšã³ãžãã¢ãªã³ã°ãå人çãªæããæããããã»å ±æå¯èœãªå®è·µã«å€ãã |
| 2023ã2024幎 | APEè«æïŒZhou et al.ïŒãšDSPyãã¬ãŒã ã¯ãŒã¯ â AIãæé©åããããã³ãã | LLMã人éãšåæ§ã«ããã³ãããæžããããšã瀺ãããïŒèªåããã³ããæé©åãå®çšçã«ãªã£ã |
| 2024幎 | Llama 3ã¯ã©ã¹ã®ã¢ãã«ïŒã³ã³ããã¹ããŠã£ã³ããŠã100äžããŒã¯ã³ãè¶ ããïŒGemini 1.5 ProïŒ | ãã©ã€ããŒãå±éã®ããã®ãªãŒãã³ãœãŒã¹LLMïŒå€§èŠæš¡ãªã³ã³ããã¹ããã³ã³ããã¹ããšã³ãžãã¢ãªã³ã°ãžã®çŠç¹ã®ã·ãããå éãã |
| 2025ã2026幎 | ã³ã³ããã¹ããã¶ã€ã³ãšãã«ããšãŒãžã§ã³ããªãŒã±ã¹ãã¬ãŒã·ã§ã³ãã·ã³ãã«ãªããã³ãã調æŽã«åã£ãŠä»£ãã | ããã³ããã£ã³ã°ã¯çµã¿åããããã³ã³ããã¹ãã®äžå±€ã«ãªã£ã â ã·ã¹ãã ã¬ãã«ã®æèãå¿ èŠ |
æŽå²ã仿¥ã®ãã¹ããã©ã¯ãã£ã¹ãã©ã®ããã«åœ¢äœãã
ããã³ãããšã³ãžãã¢ãªã³ã°ã®é²åã®åãã§ãŒãºã¯ãçŸåšã®å®è·µã«æ°žç¶çãªå ç©ç©ãæ®ããŸãããGPT-3æä»£ã¯ãã¢ãã«ã®åäœãå ¥åã®æ§é ã«ãã£ãŠåœ¢äœããã â ã³ã³ãã³ãã ãã§ãªã â ãšããã³ã¢ãªæŽå¯ãäžããŠãããŸãããæèã®é£éïŒChain-of-ThoughtïŒæä»£ã¯ãæç€ºçãªæšè«ã®è¶³å ŽãäžããŠãããŸããïŒã¹ããããã€ã¹ãããã®ããã³ããã£ã³ã°ã»ããã³ãããã§ãŒãã³ã°ã»æèããªãŒã¢ãããŒãããã¬ãŒã ã¯ãŒã¯æä»£ã¯ãåå®è·µè ããŒãããçºèŠããããšãªããã¹ããã©ã¯ãã£ã¹ãäœçŸããåå©çšå¯èœãªãã³ãã¬ãŒããäžããŠãããŸããã
RAGãšã³ã³ããã¹ããã¶ã€ã³ã®æä»£ã¯ãããã³ãããåç¬ã§ååšããã®ã§ã¯ãªã â ååŸãããããŒã¿ã»ã·ã¹ãã æç€ºã»ããŒã«åºåãšçµã¿åããããŠãã«ã³ã³ããã¹ãã圢æãã â ãšããçè§£ãäžããŠãããŸããããããŠèªåããã³ããã£ã³ã°æä»£ã¯ãåªããããã³ããã£ã³ã°ã®ååãæž¬å®å¯èœã§ããããšãæãåºãããŠãããŸããïŒããæ§é åãããããã³ããã¯ãäœç³»çã«è©äŸ¡ã»æé©åã§ããæ¹æ³ã§ããè¯ãåºåãçæããŸãã
- 2022幎ããã®æšè«ãã¯ãã㯠â Chain-of-Thought Prompting: Make AI Show Its Reasoning ãš Tree of Thought & ReAct: Advanced Reasoning for Hard Problems
- 2023幎ããã®ãã¬ãŒã ã¯ãŒã¯éçº â Which Prompt Framework Should You Use?
- ã³ã³ããã¹ããŠã£ã³ããŠã®æé· â Context Windows Explained: Why Your AI Forgets
- ã¢ãã«äžä»£ã«ãããããŒã¯ã³ã®çµæžæ§ â Tokens, Costs & Limits: The Economics of AI Prompting
- çŽç²ãªããã³ããã£ã³ã°ã®è£å®ãšããŠã®RAG â RAG Explained: How to Ground AI Answers in Real Data
é¢é£è³æ
- ããã³ãããšã³ãžãã¢ãªã³ã°ãšã¯ïŒ â ããã³ãããšã³ãžãã¢ãªã³ã°ã®å®å šãªå®çŸ©ãšãæ§é åãããå ¥åãããè¯ãçµæãããããçç±
- é£éçæèããã³ããã£ã³ã°ïŒAIã«æšè«ã衚瀺ããã â 2022å¹Žã®ææ³ãããã³ããã£ã³ã°ãæšè«ã¹ãã£ãã©ã«ãã«å€ãã
- ã©ã®ããã³ãããã¬ãŒã ã¯ãŒã¯ã䜿ãã¹ãïŒ â 2023å¹Žã®æšæºåæéããçãŸãããã¬ãŒã ã¯ãŒã¯
FAQïŒããã³ãããšã³ãžãã¢ãªã³ã°ã®é²å
ãããã³ãããšã³ãžãã¢ãªã³ã°ããšããçšèªã¯èª°ãæåã«äœã£ãã®ã§ããïŒ
æ£ç¢ºãªèµ·æºã¯è°è«ãããŠããŸãããã®çšèªã¯2021幎é ããç ç©¶æèã«ç»å Žãã2022幎ãéããŠåºã䜿ãããããã«ãªããŸãããRichard Socherã¯ãæŠå¿µãå ¬ã«åºããæå©ãããããšãã解説ã®äžã§èšåãããŠããŸããããããçºæãããšãããç¹å®ã®äººç©ã¯ããŸãããWikipediaã®ããã³ãããšã³ãžãã¢ãªã³ã°ã®èšäº Prompt Engineering â Wikipedia ã¯ãç«¶åãã䞻匵ã«ã€ããŠãã©ã³ã¹ããæŠèª¬ããŠããŸãã
ChatGPTåŸã«ããã³ãããšã³ãžãã¢ãªã³ã°ããªãççºçã«æ®åããã®ã§ããïŒ
ChatGPTã¯ãäœçŸäžãã®éç ç©¶è ãã³ãŒããæžããã«ç¡æã§å³åº§ã«äœ¿çšã§ããæåã®æ±çšAIã¢ãã«ã§ãããå·§ã¿ã«äœãããããã³ãããšæŒ ç¶ãšããããã³ããã®ã®ã£ããã¯ç®ã«èŠããŠå³åº§ã«éèŠã§ãã â ããè¯ãããã³ããã¯äœ¿ããã»ã©è¯ãåºåãçæããŸããããã®ãã£ãŒãããã¯ã«ãŒããäœçŸäžãã®äººã ã«ãã£ãŠåæã«çµéšãããããšã§ãããã³ãããšã³ãžãã¢ãªã³ã°ã¯ç ç©¶æŠå¿µãã倧è¡ã¹ãã«ãžãšå€ãããŸããã
ç ç©¶è«æã¯å®éã®ããã³ããã£ã³ã°ãã¯ããã¯ã«ã©ã®ããã«åœ±é¿ãäžããŸãããïŒ
AIç ç©¶ãšããŠã¯ç§»è»¢ãç°äŸã«éãã£ãã§ããæèã®é£éïŒChain-of-ThoughtïŒããã³ããã£ã³ã°ïŒWei et al.ã2022幎ïŒã¯ãéšåçã«ã¯ããŒã«ãå¿ èŠãšããªãã£ããã â ããã³ããã®æžãæ¹ãå€ããã ã â ãåŠè¡è«æããæ°ã¶æä»¥å ã«åºã䜿ãããå®è·µè ãã¯ããã¯ã«ãªããŸãããGPT-3è«æã®ãã¥ãŒã·ã§ããããã³ããã£ã³ã°ïŒBrown et al.ã2020幎ïŒã¯APIã¢ã¯ã»ã¹ãæã€èª°ããå³åº§ã«æ¡çšã§ãããã®ã§ããããã¯ããã¯ã®ã¢ã¯ã»ã¹ããããããã®æ®åãå éããŸããã
ã¢ãã«ãæ¹åãããã«ã€ããŠãããã³ãããšã³ãžãã¢ãªã³ã°ã¯éèŠã§ãªããªã£ãŠããŸããïŒ
ããã â ãã髿§èœãªã¢ãã«ã¯æ§é åãããããã³ããã«å¯ŸããŠããè¯ãåå¿ããŸããããå°ãªãã§ã¯ãªããã¢ãã«ã粟å¯ãªæç€ºã«åŸãèœåãåäžããã«ã€ããŠãåªããããã³ããã£ã³ã°ããã®å©çãå¢å ããŸããå€ãã£ãã®ã¯ãåçŽãªã¿ã¹ã¯ã«å¿ èŠãªããã³ãããšã³ãžãã¢ãªã³ã°ã®ã¬ãã«ã§ãïŒäŒè©±çãªè³ªåã¯2021幎ãããäœã蟌ã¿ãå¿ èŠãšããªããªããŸãããããããè€éãªæ¬çªã°ã¬ãŒãã®åºåã«ã¯ãæ§é åãããããã³ããã£ã³ã°ãå©çšå¯èœãªæãä¿¡é Œã§ããææ®µã§ããç¶ããŠããŸãã
ããã³ãããšã³ãžãã¢ãªã³ã°ãšã³ã³ããã¹ããšã³ãžãã¢ãªã³ã°ã®éãã¯äœã§ããïŒ
ããã³ãããšã³ãžãã¢ãªã³ã°ã¯éåžžãåºåãæ¹åããããã«ã¢ãã«ãžã®ããã¹ãå ¥åãèšèšããããšãæããŸããã³ã³ããã¹ããšã³ãžãã¢ãªã³ã°ã¯ãã¢ãã«ã®ã³ã³ããã¹ããŠã£ã³ããŠã«ããå šãŠã®ãã®ã調æŽããããšãæããããåºãã»ããæè¿ã®æŠå¿µã§ãïŒã·ã¹ãã ããã³ããã»ååŸããããã¥ã¡ã³ãã»äŒè©±å±¥æŽã»ããŒã«åºåã»ãŠãŒã¶ãŒå ¥å â ãã¹ãŠæå³çã«çµã¿åããããŸããã³ã³ããã¹ããšã³ãžãã¢ãªã³ã°ã¯ãããã³ãããã¹ã¿ã³ãã¢ãã³ã®ææç©ãšããŠã§ã¯ãªããèšèšãããã·ã¹ãã ã®äžã³ã³ããŒãã³ããšããŠæ±ããŸãã
èªååããŒã«ã¯ããã³ãããšã³ãžãã¢ãªã³ã°ãçè§£ããå¿ èŠæ§ã眮ãæããã§ããããïŒ
DSPyã®ãããªèªååããŒã«ã¯å®çŸ©ãããç®æšã®äžã§ããã³ããã®èšãåããæé©åã§ããŸãããç®æšãäœãã»ã©ã®ãããªå¶çŽãé©çšããããã»æåãã©ã®ããã«è©äŸ¡ããããæå®ããã«ã¯äººéãå¿ èŠã§ããããã³ãããšã³ãžãã¢ãªã³ã°ã®ååãçè§£ããããšã¯ããããã®ããŒã«ã广çã«äœ¿ãããã«ããããŠééã£ãçµæãçæãããšãã«èšºæããããã«å¿ èŠã§ããç¶ããŸããèªååã¯æåã®ã€ãã¬ãŒã·ã§ã³ã®äžéšãåãé€ããŸãïŒæ§é åãããæèã®å¿ èŠæ§ã¯åãé€ããŸããã
ããã³ãããšã³ãžãã¢ãªã³ã°ã¯2026å¹Žã«æä»£é ãã«ãªã£ãŠããŸããïŒ
ãããããã®åéã¯å€åããŸããããæ¶ããŠã¯ããŸãããã¢ãã«ã髿§èœã«ãªãã«ã€ããŠãäœæ¥ã¯æ§æã®ããªãã¯ããã³ã³ããã¹ãèšèšââå ¥åã®æ§é åãæ€çŽ¢ã®ç®¡çãããŒã«åºåã®æ§æââãžãšç§»è¡ããŠããŸãããããã³ãããšã³ãžãã¢ããšããè·çš®ã¯çž®å°ããŠããŸãããã¹ãã«èªäœã¯AIã䜿çšãããã¹ãŠã®åœ¹å²ã«çµã¿èŸŒãŸããŠããŸãïŒéçºè ãã¢ããªã¹ããããŒã±ã¿ãŒãç ç©¶è ãMcKinsey 2024 State of AI ã¯ã广çãªAIå°å ¥ãã¢ãã«ãžã®ã¿ã¹ã¯ã®äŒãæ¹ãšäŸç¶ãšããŠåŒ·ãçžé¢ããŠããããšãçºèŠããŸããã
ã¢ãã«ãæ¹åãç¶ããäžã§ããã³ãããšã³ãžãã¢ãªã³ã°ãåŠã¶å¿ èŠããããŸããïŒ
ã¯ãââãã ãäžä»£ããšã«çŠç¹ãå€ãããŸãã髿§èœãªã¢ãã«ã¯è€éãªåé¿çã®å¿ èŠæ§ãæžãããæç¢ºãªæå³ãæ§é åãããã³ã³ããã¹ããé©åãªãµã³ãã«ã®äŸ¡å€ãé«ããŸãã圹å²ãã³ã³ããã¹ãã圢åŒãå¶çŽãšãããã¡ã³ãã¡ã³ã¿ã«ãºã¯ã¢ãã«äžä»£ãè¶ ããŠå®å®ããŠããŸãã
ããã³ãããšã³ãžãã¢ãªã³ã°ãšãã¡ã€ã³ãã¥ãŒãã³ã°ã®éãã¯äœã§ããïŒ
ããã³ãããšã³ãžãã¢ãªã³ã°ã¯ã¢ãã«ã®éã¿ãå€ããã«ã¢ãã«ãšã®å¯Ÿè©±æ¹æ³ãå€ããŸãããã¡ã€ã³ãã¥ãŒãã³ã°ã¯æ°ããããŒã¿ã§ã¢ãã«ãåãã¬ãŒãã³ã°ãããã®åäœãæ°žç¶çã«å€æŽããŸããããã³ãããšã³ãžãã¢ãªã³ã°ã¯éããå®äŸ¡ã§ãå¯éçã§ãããã¡ã€ã³ãã¥ãŒãã³ã°ã¯ç®æšã®åäœãäžå®ã§ãé«ããªã¥ãŒã ã§ããŸãã¯ããã³ããã§ç¢ºå®ã«èšè¿°ã§ããªãå Žåã«é©ããŠããŸããã»ãšãã©ã®ããŒã ã¯ããã³ããã£ã³ã°ããå§ããããã³ããã£ã³ã°ãéçã«éãããšãã®ã¿ãã¡ã€ã³ãã¥ãŒãã³ã°ã«åãæ¿ããŸãã