Is it safe to upgrade kernel manually on a system which is using NVIDIA drivers?

Upgrading kernel manually on Ubuntu 14.04 can cause trouble with NVIDIA drivers? (one of the troubles could be booting to black screen)

I had lot of trouble with installing NVIDIA graphics drivers and getting it work, I had to reinstall my Ubuntu 14.04 four times.

Few reasons were installing nvidia*.run file and booting to black screen, or installing Intel Graphics for Linux and booting to black screen etc. I am tired of solving those problems.

I am want to know if there could be any problem before upgrading Linux kernel. Any advice would help