More precisely, each variety may differ in its phonetic implementation rules, phonology, lexical items or semantics, morphology, syntax, and the pragmatic functions of discourse markers or syntactic structures.
Dialects still build on it's base language, so being able to use certain dialects instead of SE in certain scenarios isn't a crazy idea.