Yes, you can do it by adding readonly="1" attribute in the state/stage_id field in kanban view in XML file.

Ex:

# Add readonly="1" to the field on which groupby is used in kanban
<kanban>
    <field name="stage_id" readonly="1"/> or 
    <field name="state" readonly="1"/>
</kanban>

        // Deactivate the drag'n'drop if the groupedBy field:
        // - is a date or datetime since we group by month or
        // - is readonly (on the field attrs or in the view)