In the realm of artificial intelligence, enabling Large Language Models (LLMs) to navigate and interact with graphical user interfaces (GUIs) has been a notable challenge. While LLMs are adept at processing textual data, they often encounter difficulties when interpreting visual elements like icons, buttons, and menus. This limitation restricts their effectiveness in tasks that require… →

Efficiently handling long contexts has been a longstanding challenge in natural language processing. As large language models expand their capacity to read, comprehend, and generate text, the attention mechanism—central to how they process input—can become a bottleneck. In a typical Transformer architecture, this mechanism compares every token to every other token, resulting in computational costs… →

Whole Slide Image (WSI) classification in digital pathology presents several critical challenges due to the immense size and hierarchical nature of WSIs.  WSIs contain billions of pixels and hence direct observation is computationally infeasible. Current strategies based on multiple instance learning (MIL) are effective in performance but considerably dependent on large amounts of bag-level annotated… →

As artificial intelligence (AI) continues to gain traction across industries, one persistent challenge remains: creating language models that truly understand the diversity of human languages, including regional dialects and local cultural contexts. While advancements in AI have primarily focused on English, many languages, particularly those spoken in the Middle East and South Asia, remain underserved.… →

In recent years, language models have been pushed to handle increasingly long contexts. This need has exposed some inherent problems in the standard attention mechanisms. The quadratic complexity of full attention quickly becomes a bottleneck when processing long sequences. Memory usage and computational demands increase rapidly, making it challenging for practical applications such as multi-turn… →