Jais (Language Model)

Jais is an open-source large language model developed in the United Arab Emirates and launched in August 2023. It was trained on both English- and Arabic-language data.

Origin

Jais is named after Jebel Jais, the highest mountain in the United Arab Emirates.^[1] It was created in collaboration between the Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) in Abu Dhabi, California -based Cerebras Systems and Inception, a subsidiary of G42.^[1]^[2]^[3]

Training

Jais has 13 billion parameters, with an update for 30 billion in the works as of October 2023.^[3] It was trained for over 21 days by a team in Abu Dhabi on a subset of Cerebras's Condor Galaxy 1 supercomputer.^[1]^[2]

Its training dataset consisted of Arabic and English, some containing computer code.^[1]^[3] According to Timothy Baldwin, provost, and professor of natural language processing at MBZUAI, training the model on a diverse Arabic dataset allows it to switch between dialects.^[3]

Features

Jais focuses exclusively on English and Arabic translations.^[4] Additional functionality for working with images, graphs and tabular data is planned for future releases.^[3]

References

↑ ^1.0 ^1.1 ^1.2 ^1.3 Cherney, Max A. (2023-08-30). "UAE's G42 launches open source Arabic language AI model" (in en). Reuters. https://www.reuters.com/technology/uaes-g42-launches-open-source-arabic-language-ai-model-2023-08-30/.
↑ ^2.0 ^2.1 Kerr, Simeon; Murgia, Madhumita (2023-08-30). "UAE launches Arabic large language model in Gulf push into generative AI". Financial Times. https://www.ft.com/content/ab36d481-9e7c-4d18-855d-7d313db0db0d.
↑ ^3.0 ^3.1 ^3.2 ^3.3 ^3.4 Tutton, Mark (2023-10-04). "Arabic AI could help open doors for other languages" (in en). https://www.cnn.com/2023/10/04/middleeast/jais-arabic-ai-open-doors-spc-intl/index.html.
↑ Ray, Tiernan (September 1, 2023). "Cerebras and Abu Dhabi build world's most powerful Arabic-language AI model" (in en). https://www.zdnet.com/article/cerebras-and-abu-dhabi-build-worlds-most-powerful-arabic-language-ai-model/.

External links

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Jais (language model). Read more

[:0-1] 1.0 ^1.1 ^1.2 ^1.3 Cherney, Max A. (2023-08-30). "UAE's G42 launches open source Arabic language AI model" (in en). Reuters. https://www.reuters.com/technology/uaes-g42-launches-open-source-arabic-language-ai-model-2023-08-30/.

[:1-2] 2.0 ^2.1 Kerr, Simeon; Murgia, Madhumita (2023-08-30). "UAE launches Arabic large language model in Gulf push into generative AI". Financial Times. https://www.ft.com/content/ab36d481-9e7c-4d18-855d-7d313db0db0d.

[:2-3] 3.0 ^3.1 ^3.2 ^3.3 ^3.4 Tutton, Mark (2023-10-04). "Arabic AI could help open doors for other languages" (in en). https://www.cnn.com/2023/10/04/middleeast/jais-arabic-ai-open-doors-spc-intl/index.html.

[4] Ray, Tiernan (September 1, 2023). "Cerebras and Abu Dhabi build world's most powerful Arabic-language AI model" (in en). https://www.zdnet.com/article/cerebras-and-abu-dhabi-build-worlds-most-powerful-arabic-language-ai-model/.