In a report, Groq states its LPUs are scalable and can be linked collectively applying optical interconnect across 264 chips. It can further more be scaled using switches, but it can include to latency. According to the https://www.sincerefans.com/blog/groq-funding-and-products