The problem was I put the icon in the assets in docs. However those are not in the python package that is installed via pip. Thus it didn't work. I moved the image inside the gui folder.