I want to insert data from .csv file into MSSql Table without converting data into .xlsx file manually.Is there any option? (or) Any connector available?
You can use Parse CSV action from Plumsail Documents connector. It allows you to convert CSV into an array and variables for each column. Please read this article demonstrating how it works.
Then you could iterate through result array and insert records into your SQL table.