In the launcher editor, select Close Button in the Structure section.
Turn on Display. Then configure the rest based on your preference.