We study the spontaneous emission of a two-level quantum emitter next to a plasmonic nanoparticle beyond the Markovian approximation and the rotating-wave approximation (RWA) by combining quantum dynamics and classical electromagnetic calculations. For emitters with decay times in the picosecond to nanosecond time regime, as well as located at distances from the nanoparticle up to its radius, the dynamics with and without the RWA and the transition from the non-Markovian to the Markovian regime are investigated. For emitters with longer decay times, the Markov approximation proves to be adequate for distances larger than half the nanoparticle radius. However, the RWA is correct for all distances of the emitter from the nanoparticle. For short decay time emitters, the Markov approximation and RWA are both inadequate, with only the RWA becoming valid again at a distance larger than half the nanoparticle radius. We also show that the entanglement dynamics of two initially entangled qubits interacting independently with the nanoparticle may have a strong non-Markovian character when counter-rotating effects are included. Interesting effects such as entanglement sudden death, periodic entanglement revival, entanglement oscillations, and entanglement trapping are further observed when different initial two-qubit states and different distances between the qubit and the nanoparticle are considered.