There's also something to learn from styles of books. It's hard to describe. You know how the movie Memento is backwards? Well I for one, before seeing that film, never even considered you could tell a story that way. The same can be said of books. There are certain sylistic choices, that can only be found word on a page (and not in film, television etc), that when you read them you think, "Wow, now that is new and different, I really want to try it."
Writing a story isn't about just going from A to B, but how the author gets you there. Reading more novels allows you to see the breadth of possibility that you might not have otherwise known about. This is not to say you don't have a vast imagination, but you will be surprised how little you know (I say this as someone, nearly twice your age, who still finds it surprising how little she knows) as you start to read more and more. It's very exciting.
Also. I will confess. I was never much of a reader either. I way prefer movies. Except. . . here's the thing . . . then I find a book that is exciting and makes me want to read it all in a day it is so fabulous and I remember how much I actually love it. I always forget though. Now I have read more books than I can remember, so obviously I return to them time and time again. But I have to remind myself each time, that with every dull wordy book out there there is one fast paced exciting and so vivid that you forget you are reading words on a page and instead are just creating pictures in your head.
To be honest, it sounds to me like you've just read two books that didn't really suit you. What kind of stuff are you into, maybe I can recommend some short fast works you would like. From one movie fan to another . . . from one "not naturally inclined" reader, to another. I get your pain. But the key is not swearing off reading altogether, but rather finding books you like. It's like with television and movies, I'm sure you don't like all films. Imagine if you watched two films, but they happened to both be documentaries. And you decide you hate film because you want to see made up stories, not real life ones. Well that would be what is known as a logical fallacy. That is to say you drew a conclusion from a false premise. I think that's what's happened to you with books. You read two, you didn't like them, concluded all books were like that and left it at that.
Now to answer your question, actually I am afraid it is "No". You will be able to write to a point I am sure, but to achieve a level of sophistication that you desire, a level of sophistication you don't even know to aspire to because you haven't read it, it just won't be possible. Aside from the lack of literary finesse you will have, just practically you may find it difficult being an author, surrounding yourself with other authors, and never reading. For one thing it will make you feel very ignorant when others go on and on about books etc. For another, it will make you come across very self absorbed, because the writing world is one of give and take. If you want blurbs for your cover from other authors, you'd better read their stuff. You want beta readers, you'd better respond in turn. You want to educate others, you'd better have a reference point aside from your own experience.
Lastly remember that absolutes for the most part serve us little use. What point is it to declare you will never read another book? Why not? What are you trying to prove in that statement? The truly enlightened individual challenges him/herself. Finds what scares them, what bores them, what confuses them, and decides instead of avoiding it, to investigate it. Face your challenges head on. It will make you stronger, wiser, and probably pretty awesome to hang out with.