Mobile OSes will ask (and act directly, if ignored) backgrounded apps to dump themselves out to disk to reclaim memory when needed, and the kinds of processing you’re allowed to do while backgrounded are quite limited.
There’s really not much of a performance reason to kill backgrounded apps. Feel free to kill them for other reasons, like unnecessary network traffic or draining your battery by keeping GPS active.