code: public static void deleteAlias(final File keystoreFile, String alias, final String password)
  		throws NoSuchAlgorithmException, CertificateException, FileNotFoundException,
  		KeyStoreException, IOException
  	{
  		KeyStore keyStore = KeyStoreFactory.newKeyStore(KeystoreType.JKS.name(), password,
  			keystoreFile);
  
  		keyStore.deleteEntry(alias);
  		keyStore.store(new FileOutputStream(keystoreFile), password.toCharArray());
  	}
docs: Delete the given alias from the given keystore file.
  
  @param keystoreFile
  the keystore file
  @param alias
  the alias
  @param password
  the password
  @throws NoSuchAlgorithmException
  the no such algorithm exception
  @throws CertificateException
  the certificate exception
  @throws FileNotFoundException
  the file not found exception
  @throws KeyStoreException
  the key store exception
  @throws IOException
  Signals that an I/O exception has occurred.