at that age, no it's not a bad thing. But in a month or so you should have him transitioned to sleeping in his bed more often, and more regularly.
The easiest way to transition him is to have the swing be in his bedroom, make sure his bedroom is DARK (I use black felt, the heaviest you can find, usually 2 layers, hang it up with the scratchy part of the velcro - stick scratchy part of velcro on top edges of the window, have felt at least 12 inches wider and 12 inches longer then window dimensions, hang up felt and push into corners of the window. Dark is good, makes the body sleep better. Also put on either a fan or music on continuous repeat so that it doesn't stop at all.
Another component is schedule. EASY - when the baby wakes up it Eats. After you feed it, then it has Activity - bouncy seat, tummy time, sitting up and playing with toys, swing, exersaucer, etc. When the baby gets fussy check the B's - boredom, butt or burp. If it's none of those then off to Sleep. Don't wait for the baby to do more than get the tiniest bit fussy, then see what is causing the fusses - if it's just that they needed their diaper change do that, but if it's not the activity is boring, the butt is dirty or they have to burp, then put them down. This may happen after as short as 45 minutes, don't freak, it really means they are tired.
Now, to get them to sleep use the 5 s's. Swaddle the baby, hold the baby on their side and sway as they suck on something (paci, your knuckle or their finger/thumb) and make a shush noise. This will calm your baby. When the baby is calm, but not asleep yet, keeping them swaddled lay them in the bed. I like to pat them instead of sway after a minute or two cause you can still pat after they are put down but you can't sway, so pat the baby and continue patting gradually decreasing it as you put them in the bed. Also continue the shushing as you put them down, again gradually getting quieter.
If you do these two you will find a well rested, easily managed baby in no time. If a baby wakes before 1 1/2 hours then wait ten minutes before going in, most babies settle in that time period and go right back to sleep on their own.