Semiconductor Engineering

Transformers At The Edge: Efficient LLM Deployment

Since the groundbreaking 2017 publication of “Attention Is All You Need,” the transformer architecture has fundamentally reshaped artificial intelligence research and development. This innovation laid ...
InfoQ

Meta Open-Sources Byte Latent Transformer LLM with Improved Scalability

Meta open-sourced Byte Latent Transformer (BLT), an LLM architecture that uses a learned dynamic scheme for processing patches of bytes instead of a tokenizer. This allows BLT models to match the ...
VentureBeat

'Western Qwen': IBM wows with Granite 4 LLM launch and hybrid Mamba/Transformer architecture

IBM today announced the release of Granite 4.0, the newest generation of its homemade family of open source large language models (LLMs) designed to balance high performance with lower memory and cost ...
Geeky Gadgets

Diffusion LLMs Arrive : Is This the End of Transformer Large Language Models (LLMs)?

The development of large language models (LLMs) is entering a pivotal phase with the emergence of diffusion-based architectures. These models, spearheaded by Inception Labs through its new Mercury ...
News Medical

Insilico and NVIDIA unveil new LLM transformer for solving biological and chemical tasks

In a new paper, researchers from clinical stage artificial intelligence (AI)-driven drug discovery company Insilico Medicine ("Insilico"), in collaboration with NVIDIA, present a new large language ...
VentureBeat

New LLM optimization technique slashes memory costs up to 75%

Researchers at the Tokyo-based startup Sakana AI have developed a new technique that enables language models to use memory more efficiently, helping enterprises cut the costs of building applications ...