December 16, 2017, 05:13:07 PM
News: If someone gives you crap then give them a Bad Star
Pages: [1] 2 3 ... 10
 1 
 on: December 08, 2017, 04:26:37 PM 
Started by Bonker Gudd - Last post by msimmons
A dev system is pretty much static, there's data to play with and such but nothing really changes. A Prod system is alive, and dynamic. The data is constantly changing, as there could be 100's or 1000's of people working with it at the same time.
Ah so only your data is different, the code is the same. I was thinking you were saying the systems didn't match. (I have a difference in mine because you can't use a credit card "swiper"" or "pin pad" in a dev environment, yet I have to develop it somehow... so doing it live...


Yep that's a lot of data. What the heck do you do with all that data?
very good question... My largest tables are full of the xml transmissions that go back & forth between apis so I can prove when things are not our fault. One of my proposals is that I move these to a separate database (on the same server) to make managing backups (and recoveries) easier.


How many tables are in this database? Are they all relatable? Are they all used? That would be my first check, are there any tables that are just no longer used. If they are no longer used how old is the data inside them.
There are a lot (50-100) tables and I would say at least 95% are in use. Think about when you are making a hotel reservation and you want to add a "package" (like breakfast), I have 12 tables for that alone.


That would be my first check, are there any tables that are just no longer used. If they are no longer used how old is the data inside them.
I think I made the is it used and can i delete this old data check a few years ago, and for a time (before we added more drives to the server) I was running a script monthly that was deleting records older than a decided date from certain tables.


You know there's plenty of software that can generate a diagram for you so you can see how the tables are related. That I think would be a good start, and then see how the code relates to the database tables.
That would be a good start! Have any suggestions (or keywords to Bing)? I feel like I tried to find something before but could not. I think one of the biggest issues is that the software has been around, and evolving, for about 20 years so there may be some underlying items that are running unnoticed, but correctly, and I don't want to disturb them... We do have a mix of languages, although I'm phasing out what I can when I can and replacing with .net.

 

 2 
 on: December 08, 2017, 03:56:16 PM 
Started by Bonker Gudd - Last post by Jason Reed
heh I read this a few times and am still confused. (If I understand correctly, your dev & prod are very different, why is that?)

A dev system is pretty much static, there's data to play with and such but nothing really changes. A Prod system is alive, and dynamic. The data is constantly changing, as there could be 100's or 1000's of people working with it at the same time. You screw up something there it can affect a lot of people really fast. Oh and there's no SVN. There's no versioning in the code. You activate the code and all the old stuff is gone, and never coming back. In a dev system you screw up the programming, you have time to figure out what you did wrong, and correct it and get it all back working again. Do that on a live system and it could make your 48 hour hell this week seem like a walk in the park.

I've actually heard they don't want foreigners slaughtering their language so will speak other's tongues to prevent it.

My wife's suggestion is that it is more like that the German realizes that they probably speak better English than the English speaker speaks German and so to facilitate an easier communication the German will speak English.

Damn thing is over 1tb... I'd really like the time to get rid of duplication and unused things, but that's not likely to happen. I get buried in constant requests for new features while having a backlog of big fixes (most likely due to everything being rushed).

Yep that's a lot of data. What the heck do you do with all that data?

exactly! This database has been around for over 17 years, migrated & upgraded from server to server, maintained & modified by different people depending on the "era." I find dumb crap like tables that don't have indexes, or tables that have too many indexes (indexes are good for seeking/reading, bad for inserting), and honestly, while I do want to learn... I don't want to learn... I just want to be a programmer Another Tounge When I say "we should have a DBA give the database a once over, to correct some of these glaring issues" I receive "well, we could hire someone, or y'all can have an xmas bonus." So duck it.

How many tables are in this database? Are they all relatable? Are they all used? That would be my first check, are there any tables that are just no longer used. If they are no longer used how old is the data inside them.

I guess if I ever get a second to breath, my first step is to diagram what the actual data flows even are... What seems to be the straw breaking the camel's back is that we have a client that uses our incoming api, which makes some updates, then pushes that data out to various sources. It's actually pushing WAY more out than what is coming in since there are not only more locations to go to, but we have "derived" values that are based on the values they update... So I may need to figure out how to throttle or adjust timings...

You know there's plenty of software that can generate a diagram for you so you can see how the tables are related. That I think would be a good start, and then see how the code relates to the database tables.

 3 
 on: December 07, 2017, 02:03:54 PM 
Started by Bonker Gudd - Last post by msimmons
Yeah, gift giving doesn't come to me naturally. I mean one of our first Christmases together I bought her pots and pans doh. Funny enough she stayed with me Wink
heh, depending on the situation I can see pots & pans being a good gift laugh1


I've gotten better though, but it's still not easy to get everything together, and hope that I'm giving her as much as she gives me. Thankfully I don't have siblings and my mother doesn't celebrate so I don't have to worry about it, just the wife, and three boys Grin
And you probably have a good idea of what they would like, I can't think of anything one of my sisters would be interested in, and the other sister most likely has everything she would want in relation to the interests I know of...


The problem is that we don't have the fastest dsl available, usually because we wouldn't use it. We don't stream a lot of videos or tv. The thing is that technology eventually assumes that you'll have the bandwidth and just takes what it wants. It's kind of like how software became very bloated and bad at memory management once it was normal for more people to have more memory.
Yeah, I worry about my phone data on occasion. When I'm on wifi I don't care what it's doing, but I don't know if it's smart enough to not eat up my "minutes" doing things I don't really need.


Working in SAP when it is our development environment is nothing like working in a live system. That's where you get your real experience.
heh I read this a few times and am still confused. (If I understand correctly, your dev & prod are very different, why is that?)


Exactly, I've done it many times where I visited places where I didn't speak the language.
I totally missed the "not" in your "not the first time" doh


The difference is that most of the time Germans will actually try to speak English. The French are not known to be like that. Of course that's why there's Google Translate Wink
I've actually heard they don't want foreigners slaughtering their language so will speak other's tongues to prevent it.


Good to hear that you got it fixed. Large database systems always scare me :couch:
Damn thing is over 1tb... I'd really like the time to get rid of duplication and unused things, but that's not likely to happen. I get buried in constant requests for new features while having a backlog of big fixes (most likely due to everything being rushed).


Sounds to me that the APIs and/or the database handling needs some optimization if a customer slams it and it has problems, is it some sort of threading problem?
exactly! This database has been around for over 17 years, migrated & upgraded from server to server, maintained & modified by different people depending on the "era." I find dumb crap like tables that don't have indexes, or tables that have too many indexes (indexes are good for seeking/reading, bad for inserting), and honestly, while I do want to learn... I don't want to learn... I just want to be a programmer Another Tounge When I say "we should have a DBA give the database a once over, to correct some of these glaring issues" I receive "well, we could hire someone, or y'all can have an xmas bonus." So duck it.

I guess if I ever get a second to breath, my first step is to diagram what the actual data flows even are... What seems to be the straw breaking the camel's back is that we have a client that uses our incoming api, which makes some updates, then pushes that data out to various sources. It's actually pushing WAY more out than what is coming in since there are not only more locations to go to, but we have "derived" values that are based on the values they update... So I may need to figure out how to throttle or adjust timings...

 4 
 on: December 07, 2017, 10:12:12 AM 
Started by Bonker Gudd - Last post by Jason Reed

I really hate this time of year due to gift giving (and feeling that there is an imbalance between my siblings and I)... We can do the whole "thank you for the gift card, here is a gift card" which just feels silly (although when I receive a gift card I do make sure to 1. spend it on a something I might not otherwise buy for myself and 2. let the gifter know what they got me. Being that my siblings don't do the same, I don't have any feed back that they actually liked the gift. I'd like to get them actual gifts, but we all buy the things we want, for ourselves, when we want them Another Tounge (and I don't really know them well enough to know what to get or what they have). I'd like to say "can we just not do gifts this year?" but don't want to sound like a cheapskate or jerk sofa
Yeah, gift giving doesn't come to me naturally. I mean one of our first Christmases together I bought her pots and pans doh. Funny enough she stayed with me Wink I've gotten better though, but it's still not easy to get everything together, and hope that I'm giving her as much as she gives me. Thankfully I don't have siblings and my mother doesn't celebrate so I don't have to worry about it, just the wife, and three boys Grin

doing anything or just relaxing?

Sadly I'll probably be doing everything not to get sick. It's been a while since I've been really sick, and the last couple of weeks have been stressful, and the next two aren't going to be much better, so I'm prime for a nasty one. So I'll be fighting it every step of the way.

Sounds annoying. Looks like my Sanwa does 6 lines, I've never tried to modify it though.

I have to look maybe I can make it work better, I just have to remember that when I'm viewing a map I shouldn't use the scroll wheel.

Reading that makes me feel pretty fortunate that I don't have to worry about bandwidth.
The problem is that we don't have the fastest dsl available, usually because we wouldn't use it. We don't stream a lot of videos or tv. The thing is that technology eventually assumes that you'll have the bandwidth and just takes what it wants. It's kind of like how software became very bloated and bad at memory management once it was normal for more people to have more memory.

Hopefully it will come naturally in time, with practice yes
Yeah, I just need to get good enough where the project manager actually uses me. Working in SAP when it is our development environment is nothing like working in a live system. That's where you get your real experience.

What about when you first came to Germany?
Exactly, I've done it many times where I visited places where I didn't speak the language. The difference is that most of the time Germans will actually try to speak English. The French are not known to be like that. Of course that's why there's Google Translate Wink

And a rough two weeks it has been sweat I have gotten more used to my phone at least Another Tounge

So... I have a script that deletes a certain chunk of client's data that I use on the rare occasion it gets corrupted (typically when our system is fed via an api). Well, this new client was hammering our system and the sql locks were resulting in corrupt data. I didn't want to wipe the entire profile, only about 10% though, so I looked up the id I needed then modified my script... and wiped the whole.ducking.table...

1pm: I didn't realize my mistake till another client called in... at which point I scrambled to set up a second database to restore a backup. I didn't want to do a full restore over top of our existing data as we would lose teh data that came into other tables. The next issue was that I simply didn't have room to create a second database... So I contacted our host (my hope was they could "loan" us a server) and they suggested we pop on a 2tb external drive (I didn't know they made them that large).
5pm: The restore finally got started, I stayed at the office, getting 30-60 minute updates "5%" "10%" till I decided there really wasn't anything I could do, so I went home and ate around 9pm.
10pm: I calculated that it should be done at roughly 2-5am, and that I should try to sleep... but that wasn't easy to do. I was receiving half hourly updates
2am: (as expected) I received a "we're at 92%, I'll update you shortly" but then I didn't hear back for over an hour... so my mind started telling me all kinds of things went wrong... so I called them at about 3-4am. It turns out that when a restore hits 100%, it does some stuff, and in the case of my database, this step can take an hour...
4am: don't try to open the error log file, on the server, if it's huge... the tech crashed sql server and when it came up it was no longer in "restore" mode, but when we tried to bring it online... it said that the restore was interrupted... I have to assume due to that crash... so let's start the process over again...
7-8am: I went to teh office as usual, not sure if I would even have a job (of course they aren't going to fire the one guy that can restore the data before he restores it) after I get all the data back... I knew it would be at least noon before the current restore would be ready, so I tried to rebuild some of our more important (read: complainers) clients data from various log tables... unfortunately that wasn't possible because i needed some database id's that were only logged if the client did an update.
1pm: restore is at 100%, now for the unknown amount of time till it goes from 100% to complete (turns out there is a flag that could have been set that would give a % on this step, but the tech didn't set it and/or was unaware of it)
2pm: restore is back up and 10 minutes later I have imported the table I wiped. I checked the logs and there was no new data inserted, so we were totally back online and all good!

(pretty sure my job is safe, later that day, or the next, we had a meeting regarding future projects sofa )

Good to hear that you got it fixed. Large database systems always scare me :couch:

Sounds to me that the APIs and/or the database handling needs some optimization if a customer slams it and it has problems, is it some sort of threading problem?

 5 
 on: December 06, 2017, 11:47:14 AM 
Started by Bonker Gudd - Last post by msimmons
Some days it feels like the year will never end, and then sometimes it feels like it's all going too fast.
I really hate this time of year due to gift giving (and feeling that there is an imbalance between my siblings and I)... We can do the whole "thank you for the gift card, here is a gift card" which just feels silly (although when I receive a gift card I do make sure to 1. spend it on a something I might not otherwise buy for myself and 2. let the gifter know what they got me. Being that my siblings don't do the same, I don't have any feed back that they actually liked the gift. I'd like to get them actual gifts, but we all buy the things we want, for ourselves, when we want them Another Tounge (and I don't really know them well enough to know what to get or what they have). I'd like to say "can we just not do gifts this year?" but don't want to sound like a cheapskate or jerk sofa


My last vacation for this year is scheduled, basically I won't work between Christmas and New Years, since nothing is going on during this time. Grin
doing anything or just relaxing?


The new computer is great. Do have one small issue with the trackball though, the Logitech drivers don't allow you to set the amount of the wheel scrolls very accurately. So when I'm on a map and move it one click to zoom in a little, I get like 4x zoom, but if I make the changes to the Windows Mouse configurations so that only one line is changed by the scroll wheel, then I might as well not have scroll wheel. That's rather annoying.
Sounds annoying. Looks like my Sanwa does 6 lines, I've never tried to modify it though.


I'll be happy if Microsoft ever makes the updates in smaller batches. These giant updates, take forever to download and install. They also tend to suck up so much bandwidth, it makes our internet pretty much unsuable until the download is complete. Otherwise it causes so many errors in the update, that the download has to start from the beginning again. That's rather annoying.
Reading that makes me feel pretty fortunate that I don't have to worry about bandwidth.


Work has been keeping me pretty busy, but I'm still struggling to get my head around the SAP programming, and in doing it correctly. I can get simple results, but when it is something more challenging then I take too long. I need to improve a lot.
Hopefully it will come naturally in time, with practice yes


Yesterday we booked our vacation house for next spring. You have to book early or all the good spots are taken Wink. We're going to France this time, close to the Normandy coast. It's not the first time I've visited a country and not be able to speak the language. We'll just have to see how that works out for us unsure
What about when you first came to Germany?


Wow can't believe it's been 2 weeks since the last posting Grin

Hope everyone is doing ok.
And a rough two weeks it has been sweat I have gotten more used to my phone at least Another Tounge

So... I have a script that deletes a certain chunk of client's data that I use on the rare occasion it gets corrupted (typically when our system is fed via an api). Well, this new client was hammering our system and the sql locks were resulting in corrupt data. I didn't want to wipe the entire profile, only about 10% though, so I looked up the id I needed then modified my script... and wiped the whole.ducking.table...

1pm: I didn't realize my mistake till another client called in... at which point I scrambled to set up a second database to restore a backup. I didn't want to do a full restore over top of our existing data as we would lose teh data that came into other tables. The next issue was that I simply didn't have room to create a second database... So I contacted our host (my hope was they could "loan" us a server) and they suggested we pop on a 2tb external drive (I didn't know they made them that large).
5pm: The restore finally got started, I stayed at the office, getting 30-60 minute updates "5%" "10%" till I decided there really wasn't anything I could do, so I went home and ate around 9pm.
10pm: I calculated that it should be done at roughly 2-5am, and that I should try to sleep... but that wasn't easy to do. I was receiving half hourly updates
2am: (as expected) I received a "we're at 92%, I'll update you shortly" but then I didn't hear back for over an hour... so my mind started telling me all kinds of things went wrong... so I called them at about 3-4am. It turns out that when a restore hits 100%, it does some stuff, and in the case of my database, this step can take an hour...
4am: don't try to open the error log file, on the server, if it's huge... the tech crashed sql server and when it came up it was no longer in "restore" mode, but when we tried to bring it online... it said that the restore was interrupted... I have to assume due to that crash... so let's start the process over again...
7-8am: I went to teh office as usual, not sure if I would even have a job (of course they aren't going to fire the one guy that can restore the data before he restores it) after I get all the data back... I knew it would be at least noon before the current restore would be ready, so I tried to rebuild some of our more important (read: complainers) clients data from various log tables... unfortunately that wasn't possible because i needed some database id's that were only logged if the client did an update.
1pm: restore is at 100%, now for the unknown amount of time till it goes from 100% to complete (turns out there is a flag that could have been set that would give a % on this step, but the tech didn't set it and/or was unaware of it)
2pm: restore is back up and 10 minutes later I have imported the table I wiped. I checked the logs and there was no new data inserted, so we were totally back online and all good!

(pretty sure my job is safe, later that day, or the next, we had a meeting regarding future projects sofa )

 6 
 on: December 05, 2017, 03:29:38 PM 
Started by Bonker Gudd - Last post by Jason Reed
Some days it feels like the year will never end, and then sometimes it feels like it's all going too fast.

My last vacation for this year is scheduled, basically I won't work between Christmas and New Years, since nothing is going on during this time. Grin

The new computer is great. Do have one small issue with the trackball though, the Logitech drivers don't allow you to set the amount of the wheel scrolls very accurately. So when I'm on a map and move it one click to zoom in a little, I get like 4x zoom, but if I make the changes to the Windows Mouse configurations so that only one line is changed by the scroll wheel, then I might as well not have scroll wheel. That's rather annoying.

I'll be happy if Microsoft ever makes the updates in smaller batches. These giant updates, take forever to download and install. They also tend to suck up so much bandwidth, it makes our internet pretty much unsuable until the download is complete. Otherwise it causes so many errors in the update, that the download has to start from the beginning again. That's rather annoying.

I'm currently configuring the laptop for my wife's colleague. She bought a new laptop and asked if I could do all the data transfer, and setup. Normally I don't mind doing that but with these Windows 10 updates it takes forever :blah:

Work has been keeping me pretty busy, but I'm still struggling to get my head around the SAP programming, and in doing it correctly. I can get simple results, but when it is something more challenging then I take too long. I need to improve a lot.

Yesterday we booked our vacation house for next spring. You have to book early or all the good spots are taken Wink. We're going to France this time, close to the Normandy coast. It's not the first time I've visited a country and not be able to speak the language. We'll just have to see how that works out for us unsure

Wow can't believe it's been 2 weeks since the last posting Grin

Hope everyone is doing ok.

 7 
 on: November 16, 2017, 07:53:40 PM 
Started by Bonker Gudd - Last post by Bonker Gudd
Merry Easter mf_popeanim

 8 
 on: November 15, 2017, 12:28:09 PM 
Started by Bonker Gudd - Last post by msimmons
I got it working. Not sure what I did because it wouldn't let me install drivers unless it was installed. I did notice that Windows updated some NVIDIA stuff, and after that I re-installed it and plugged in the HDMI cable, started it up and boom it's working (I'm using it right now to answer this post).
heh, sometimes windows just needs some time to work its magic. I forget what the deal was but I had a similar instance with my mom when I first set up her computer... something about the profiles or something... I gave up and told her I would return another day to fix it and... it fixed itself laugh1


It's going to take a little time to get used to having such a big screen at home. Looking forward to seeing how Minecraft looks on this screen smile.
Not a bad problem to have jamie


Well yeah, when you're used to a specific user interface and now have a new one that always takes time.
Especially when that interface was FAR superior... I'm really having a hard time and to be honest I'm starting to think I can just live without the apps/features... (Which sucks cos Uber is really nice on the new phone... ) I have a few more days to send this back (I doubt I will though).


I'm wondering how long it will take my wife to get used to hers when she gets it.
I hope she has a better time than I do. I mostly used my phone for texting and it was so nice compared to this... I could hit the "mic" and just talk, hardly needed any edits... with this, I need a duckton of edits AND editing is damnduckingnear impossible... :rant:



 9 
 on: November 11, 2017, 08:27:45 AM 
Started by Bonker Gudd - Last post by Jason Reed
Check the bios, you might have to disable the onoboard although it sounds like it's being auto disabled. I did have one mobo back in 2006 that didn't work with nvidia, only amd. What outputs does the vid card have? maybe its a case of the monitor not playing well with that signal.

I got it working. Not sure what I did because it wouldn't let me install drivers unless it was installed. I did notice that Windows updated some NVIDIA stuff, and after that I re-installed it and plugged in the HDMI cable, started it up and boom it's working (I'm using it right now to answer this post).

It's going to take a little time to get used to having such a big screen at home. Looking forward to seeing how Minecraft looks on this screen smile.


edit:
totally forgot to say that i activated my android phone today... going to take some getting used to for sure...

Well yeah, when you're used to a specific user interface and now have a new one that always takes time. I'm wondering how long it will take my wife to get used to hers when she gets it.

 10 
 on: November 10, 2017, 02:00:08 PM 
Started by Bonker Gudd - Last post by msimmons
Who wants Ubertoastie?
Grilled cheese delivered to my front door? yes please! :yum:


Well after a couple of false starts I'm finally getting the computer together. Last big part is getting the video card to work. If I physically install it I get no screen from it or the integrated video on the mobo. If I leave it off then I at least get the screen over the VGA cable on the mobo dunno

Will try to install the drivers first and then install the thing. Maybe that will correct my problem :sigh:
Check the bios, you might have to disable the onoboard although it sounds like it's being auto disabled. I did have one mobo back in 2006 that didn't work with nvidia, only amd. What outputs does the vid card have? maybe its a case of the monitor not playing well with that signal.


edit:
totally forgot to say that i activated my android phone today... going to take some getting used to for sure...

Pages: [1] 2 3 ... 10