This comparison evaluates the performance of Assassination Rogues and Retribution Paladins, highlighting their strengths and weaknesses. Using SimulationCraft, each spec was tested under various conditions to analyze their capabilities in level 80 end-game PvE gameplay. Updated for patch 11.0.5 of the The War Within expansion.
Performance ComparisonPatch 11.0.5
Retribution Paladin+1.9% DPS
When simulating for maximum theoretical single-target DPS, Retribution Paladins averaged 1.9% more DPS than Assassination Rogues (+29K DPS).
Retribution Paladin+29.81% DPS
When simulating for light AoE DPS potential, with small waves of adds, Retribution Paladins averaged 29.81% more DPS than Assassination Rogues (+727K DPS).
Assassination Rogue+2.15% DPS
When upgrading the gear for both specs by +44 ilvl, Assassination Rogue DPS improved the most, +2.15% more than Retribution Paladin. In total, Assassination Rogues DPS increased by 68.07% and Retribution Paladins by 65.92%.
This category evaluates the burst DPS potential of each spec by simulating a short encounter with full raid buffs and bloodlust.
This category evaluates the solo DPS potential of each spec by simulating a typical solo delve encounter with no raid buffs.
This category evaluates the pure AoE DPS potential of each spec by simulating both specs to fight intense groups of adds, with nearly 16 adds at any given moment.
This category evaluates the performance of each spec when introducing occasional movement and stuns during boss encounters.
This category evaluates the latency tolerance of each spec by simulating both specs with moderate-to-high latency. This can indicate which spec performs better when facing high latency, whether due to far server/realm location or limited access to quality internet.
This category evaluates the skill level required to play each spec by simulating both specs with greatly reduced player skill. This can indicate which spec is more forgiving of mistakes or has a simpler rotation.
The comparisons above highlight some of the key differences between Assassination Rogue and Retribution Paladin in the current meta, which can hopefully help you determine which spec to play or group up with.
Assassination Roguevs Retribution Paladin
Retribution Paladin+1.9% DPS 
Assassination Rogue+2.15% DPS