By setting the ping limit as part of the configuration, the connections with Device Access will get disconnected and the device will become offline.

Alternatively, you can delete the device manually by pressing the "Trash" icon in the Functional Items Management (FIM) console view (IoT->FIM).

The Controller itself  always remains online and cannot be deleted.