You cannot remove these.dll files while Windows is running (which is part of Microsoft's point).
Windows relies on .dll files across various programs, so deleting one of these files will impact many programs.