You can always try. The worst thing that happens is that the upgrade fails, you go into kernel panic and restore the old kernel.

Full disclosure: in spite of trying many times I never successfully built my own kernel. I always used the latest updates available in restricted repositories. They always worked well.