The Internet of Things (IoT) domain is typically characterized by a vast array of resource-constrained heterogeneous devices. IoT services facilitated via these devices are in the form of data sensing and sharing which has enabled numerous applications like healthcare, industries 4.0, and smart cities. For data routing and networking purposes in these IoT applications, a new protocol called the Information-Centric Networking (ICN) has been proposed as an alternative to the traditional IP based networking. ICN protocol implements data routing and networking by leveraging a publish-subscribe approach between users, focusing on the contents of generated data packets and in-network caching strategies. Even though ICN improves performance metrics like network latency, it removes the need for a source-destination identification model as used in IP-networking. Hence, there is an increased need for effective data authentication schemes for IoT applications utilizing ICN. However, since IoT devices are resource-constrained in terms of available energy, memory, and processing power, any proposed authentication scheme should be optimized in terms of their resource consumption without compromising the obtained security. Along this direction, this work presents the simulation and performance analysis of different lightweight authentication schemes incorporated in an IoT based healthcare application designed using ICN.