Hi,
Try out this.You can restrict the user to insert the rows by following the below steps.
1. Go to repeating section properties. then move to display tab.
2. Click on conditional formatting.Selct the expression in first drop down and enter the following expression
count("repeating section xpath") = 10
3. Check ‘Don't allow users to insert or delete this control'. Click ok.
Hope you will understand this.