Yip the system you are using works best in pure dual channel.
Adding the other two sticks add to the work overhead and as a result runs slower in a benchmark, simply because it now has four banks to populate and refresh instead of two.
To help us help you - please provide as much information about your system and the problem as possible.