Emma,
I had Oscar on 3rd Oct, he was 38+5wks so classed as a term baby, but after 3 days he went badly jaundice and was taken to SCBU to be put on a bilibed and overhead light to help him.
I had a very positive experience of special care, the nurses were great and very supportive. That's not to say I didn't get upset at times, but then I had been wanting a home birth and to end up in hospital and then have to stay for 6 days was a slight shock but it is all worth going through as my little man is amazing!
Like Tanya said it really helps you to get prepared to take them home. One of the best things I found with him being in for that time was that I was really supported with breastfeeding so by the time he came home I was really confident with it. I don't know what you're wanting to do feedingwise but at one point Oscar really needed to get fluids into him and they did say about giving him a drip - they were happy for me to express milk and put that into the drip as well as some formula, so they are very accommodating. Fortunately we didn't need to do that in the end.
Luckily I was able to stay in a flat in SCBU because I was breastfeeding Oscar so I don't feel like I missed out on anytime with him, but if you have to leave him/her there again, like Tanya said, make the most of it because life is certainly not the same once baby is born