Abu Dhabi: The second version of the large language model (LLM), Falcon 2 11B, has been launched by the Technology Innovation Institute (TII), a renowned international scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC).
There are two versions of Falcon 2: Falcon 2 11B, which is a more accessible and effective LLM that was trained on 5.5 trillion tokens with 11 billion parameters, and Falcon 2 11B VLM, which is unique in that it can translate visual inputs into written outputs with to its vision-to-language model (VLM) capabilities. Although both models are multilingual, Falcon 2 11B VLM is noteworthy for being the first multimodal model from TII and the only model with image-to-text conversion capacity available in the top tier market right now, which represents a major breakthrough in AI innovation.
Since their debut, all of TII’s AI models have been regarded as the most potent open-source LLMs, continuously ranking in the top tier worldwide. In the rapidly changing field of generative AI, TII is expected to see more market adoption thanks to the new, more adaptable and compact Falcon 2 11B models.
HE Faisal Al Bannai, Secretary General of Advanced Technology Research Council, remarked that, “With the release of Falcon 2 11B, we’ve introduced the first model in the Falcon 2 series. While Falcon 2 11B has demonstrated outstanding performance, we reaffirm our commitment to the open-source movement with it, and to the Falcon Foundation. With other multimodal models soon coming to the market in various sizes, our aim is to ensure that developers and entities that value their privacy, have access to one of the best AI models to enable their AI journey.”
The adaptability of Falcon 2 11B has also prompted TII to think about developing more GenAI technologies. The implementation of a novel machine learning capacity called the Mixture of Experts will be one of these. By combining smaller networks with different specializations, this approach makes sure that the most expert areas work together to provide extremely complex and tailored solutions. By increasing decision-making speed and accuracy, this method opens the door for more sophisticated and effective AI systems.
The permissive Apache 2.0-based Falcon License 2.0, which contains an acceptable use policy encouraging the proper application of AI, is the license under which Falcon 2 11B is operated.