It seems like the OP is talking about a really undersized Intex-type A cartridge filter. But even in my pre-TFP days when fighting algae blooms, I still did OK vacuuming my pool bottom with a 4” shop-vac attachment (and many, many filter changes and cleanings). If it’s the newer (2) intake pool, you may want to figure how to close 1 intake only while vacuuming.
Otherwise, proper-sized cartridge (like a PP’s 400sf) filters should have no problem with a vacuum.
I know they are rarely recommended, and are more work than a robot, but my suction side Kontiki deal does a nice job 95% of the time. (I have a standard vacuum hose I’ve used a few times.