As someone else said, not necessarily. However, it could also be likely if you aren't used to working with frameworks that it could negatively impact your ability.
What kind of applications are you envisioning making? A lot of the more complex applications have so many pieces that it would be impossible for you to build it from the ground up.
Example of an interactive website: How long would it take you to become knowledge enough to implement a web server, handle authentication and storage of sensitive data, manage database connections and queries, handle caching, sends out emails, etc. Then on top of all that you create a machine learning model that receives data using computer vision that interfaces back into your website. Would you be confident that even if it all works that you haven't made a mistake that an expert has spent years devising a solution for?
Using frameworks allows you to build upon the expertise of many thousands, millions of hours and gets you closer to building the thing you actually wanted to build.