app: increase color precision in indexed conversion

This improves a color fidelity loss in conversion to indexed, with trade-offs that probably are acceptable on all platforms currently in use.