This post explains the ordering behavior: Custom Inkscape, Illustrator, CorelDraw and Affinity Designer Color Palettes for ordering operations in GFUI
So we cant force a color order to put dissimilar colors close together 
. I added a color sorter function so you can customize the POST with your own colors and they will be sorted and work correctly without having to do it manually.