Hi, I'm Prashant Gupta!

IBM Spyre is the first production-grade Artificial Intelligence Unit (AIU) accelerator born out of IBM Research. The vLLM Spyre plugin (vllm-spyre) is a dedicated backend extension that enables seamless integration of IBM Spyre Accelerator with vLLM. It follows the architecture described in vLLM’s Plugin System, making it easy to integrate IBM’s advanced AI acceleration into existing vLLM workflows.

My work focused on understanding the intricacies of inferencing optimizations and attention mechanisms within large language models to ensure efficient hardware utilization on the Spyre Accelerator.

IBM watsonx is a portfolio of AI products that accelerates the impact of generative AI in core workflows to drive productivity. Users are free to choose an open source foundation model, bring their own, or use existing models while running it across any cloud and using open, transparent technology with governance and security controls built in.

My work focused on the inference stack, ensuring models performed optimally at scale.

A minimalistic go library/app to keep your mac active and alive! The simplest app that has the sole purpose of moving your mouse pointer at regular intervals so that your machine is kept awake! And best of all, it works ONLY when you are not working, so be rest assured that the mouse won't start moving on its own without the machine actually being idle.

This was a fun weekend project to explore Multithreading with Go Routines in Golang.