Mixing relative and absolute estimation is problematic and difficult. If you were going to use relative estimation (story pointing is one form of relative estimation, while hours is absolute estimation) I would only use that. There will be some things that don't get points (spikes, bugs, etc) but usually this is a small enough percentage of the work in the sprint that it isn't particularly impactful. In this approach, we use past velocity to plan capacity instead of hours available.
Now, nothing about Scrum says you have to use relative estimation. A lot of the industry has moved away from that because studies have consistently shown absolute estimation to be wildly inaccurate in many contexts. This may not apply to you and if your context lends itself well to absolute estimation, nothing should stop you from using that, but then I would use just that. In Jira, it looks like you can change using points or Original Time Estimate in the board settings: https://confluence.atlassian.com/jirasoftwarecloud/configuring-estimation-and-tracking-764478030.html