Both your HbA1c level and your fasting blood glucose level are at the high end of 'normal'. This, undoubtedly, is why your doctor has pointed it out to you.
As others have stated, because you have a close family member, this increases your risk of developing diabetes at some point in your life.
You don't mention whether your doctor offered any advice on how to lessen the risks, but if s/he didn't I'm a little perturbed. Surely s/he should be looking at your overall medical welfare?
The reason you may not have noticed your HbA1c levels creeping up over the last few years is because, in type 2 diabetes specifically, it's an insidious condition that has a tendency to creep up on you. This is why many type 2 diabetics aren't diagnosed, sometimes, for years after they develop diabetes.
You may have read about some of the symptoms that diabetics experience. The truth is, these are more readily recognisable when someone develops type 1 diabetes mellitus ... they come on all of a sudden. Because the symptoms are not so pronounced in type 2 diabetes, many people put any thoughts to the back of their mind, thinking that they're getting older so you must need the toilet more, or that you may not have been drinking enough over the years, so your body's simply telling you that you need to drink more.
You don't mention that you're physically active ... simply that your body mass is "mostly muscle". If you don't exercise, now might be a good chance for you to change that. You don't suddenly need to join a gymnasium, walking is good. You should try to aim for 30+ minutes a day but, if this is new to you, don't feel that you need to start out immediately at these levels.
You appear to have a varied diet, sir, though I must point out that both potatoes and rice are high in carbohydrate value. These are the foods that get broken down into a simple sugar called glucose which your body needs to use to create energy. Many fruits, too, have high carbohydrate values. It might be worth asking your doctor for a referral to see a dietitian, though you may find that sticking to a lower GI (Glycemic Index) and GL (Glycemic Load) diet will serve you just as well.
GI and GL diet are NOT just for diabetics. They can be useful tools for anyone. It's just that diabetics tend to have a great deal of success in using them.
There are a few websites listed below that specifically relate to GI and GL diets that you may wish to take a look at.
Be well, sir.