Taking the dampening off the front of your crankshaft is risky, you're compromising one aspect of the engine design. most of the weight was there for a purpose, to absorb vibrations from the crankshaft over a certain frequency range.
You may be fine and get plenty of miles out of your lightened assembly anyway.
Good luck with it.