OpenAI releases new evaluation suite for ChatGPT on low-resource programming languages

OpenAI has introduced new evaluation benchmarks to assess ChatGPT's performance in low-resource programming languages, specifically targeting software engineering, SQLite operations, and COBOL migration tasks. These benchmarks aim to address the historical lack of standardized testing for languages with limited digital resources.