CLOVER introduces a novel approach for cross-layer orthogonal vectors pruning and fine-tuning in large language models, achieving efficient model compression while maintaining performance.