Running TRELLIS.2 on Apple Silicon

Why the official code is CUDA-only, what a Mac port takes, and the shortcut.

TRELLIS.2 is Microsoft's 4-billion-parameter image-to-3D model and one of the best all-round engines available. The catch on a Mac is that its reference implementation is built around NVIDIA CUDA: custom sparse-voxel and rasterization kernels that have no Apple Silicon equivalent. Running the official code on a Mac is not a matter of a flag, it needs a real port. Here is what that involves, and the shortcut.

The manual route

1

Understand what TRELLIS.2 needs

The reference repo depends on CUDA-only components: custom sparse-structure and octree rasterization kernels, fused attention, and more. These are compiled for NVIDIA GPUs and do not exist on Apple Silicon out of the box.

2

Weigh the DIY options

To run it locally without an NVIDIA GPU you either rent a cloud GPU (which defeats the point of local), or port the model to a Mac-native backend such as Apple's MLX or PyTorch MPS, reimplementing those CUDA kernels. That is a serious engineering project, not an install.

3

Convert the weights and match the pipeline

A Mac-native run needs the weights in a form the new backend can load, plus a matching sampler and mesh-extraction path. Reaching parity with the reference output is the hard part.

Unlike smaller models, TRELLIS.2 will not run on a Mac by swapping one dependency. Its CUDA kernels are the model. This is exactly the gap 3D Mate closes.

The one-click way

3D Mate ships a Mac-native TRELLIS.2 4B built on Apple's MLX, so the full 4B model runs on Apple Silicon with no CUDA, no port, and no cloud. Install it from inside the app and generate offline; a balanced result takes about 8 to 10 minutes on an M1 Pro.

Questions

Can I run TRELLIS.2 on a Mac?
Not from the official code, which is CUDA-only. 3D Mate ships a Mac-native TRELLIS.2 4B built on Apple's MLX that runs the full model on Apple Silicon, offline, with no NVIDIA GPU.
Does TRELLIS.2 need an NVIDIA GPU?
The reference implementation does. 3D Mate's MLX version runs entirely on the Mac's own GPU instead.
How much memory does it need on a Mac?
About 24 GB of unified memory at minimum, 32 GB recommended, when run in 3D Mate.