Careful! There can be huge unexpected waves crashing on to the beach out of nowhere and drag you into the freezing ocean! It's a serious risk with deadly results. So no matter how calm the ocean may seem, be aware!
If you've visited Dyrhólaey you've already seen this Reynisfjara (aka Black Sand Beach) from a distance, but it's even better from up close. The basalt columns rock formations are definitely a view worth seeing from up close.
This is also as close you'll get to Reynisdrangar, the rock pillars that rise out from the sea water just off shore.