Okay I will try to explain this....okay so time is not linear it can be warped as seen by different theories when things speed up but regardless...anyways if you were to travel back in time you would become a different entity a different person yourself but not yourself. Therefore if you were to kill your father or grandfather you would still exist in that time zone (The past) but your entity existence in your own time would no longer exist. Therefore if you were to return back to the past you would still be you but the you from the future wouldn't exist Therefore no one would know the entity that is you. You wouldn't disappear or evaporate or anything like that haha. Your memory just wouldn't exist in,the time you came from.