The Valve Junior may look cool, but its a pretty lousy amp. Hums a lot and has a very nasty and trashy 60's fuzz overdriven sound. Still, what can you expect for ?99? Its going on Ebay soon.
The Valve Junior gets some rave reviews on harmony central although single ended valve buzz is mentioned (and unavoidable). have you tried swapping valves?