Çoklu GPU, NCCL, Tensor Parallel, NVLink

NCCL bağlantı hataları, tensor parallel vs pipeline parallel seçimi, VRAM imbalance, PCIe vs NVLink, vLLM --tensor-parallel-size, Ray + multi-node.