My device is poco x3 gt. 8gb ram, dimensity 1100, mali g77 mc9. Mnn engine is very fast. The problem is when I use qwen models and feed them with images they produces gibberish. The fix is to change the memory in config.json from low to normal. The downside the processing and inference speed became very slow.
My device is poco x3 gt. 8gb ram, dimensity 1100, mali g77 mc9. Mnn engine is very fast. The problem is when I use qwen models and feed them with images they produces gibberish. The fix is to change the memory in config.json from low to normal. The downside the processing and inference speed became very slow.