In your example if you use PCA to initialize your t-SNE you get widely spaced centroids; if you use random initialization you'll get tiny centroids and an uninteresting picture.
PC’s are a series of linear least squares fits to a sample, each orthogonal to all previous
Unlock advanced customer segmentation techniques using LLMs, and improve your clustering models with advanced techniques