Be logged in on the site. Top right: hold the mouse pointer over your name. In the popup menu, click Account Settings. Scroll down and click 'Delete my account'. Easy come, easy go!
If you signed up for MyHeritage using a third-party login such as Facebook or Twitter, you probably want to revoke all access from MyHeritage. Click the icon below to find out how.